2023-11-19T00:27:32.326 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-19T00:27:32.326 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827 --owner scheduled_yuriw@teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} --verbose -- /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/orig.config.yaml 2023-11-19T00:27:32.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T00:27:32.433 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} email: yweinste@redhat.com first_in_suite: false job_id: '7461827' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 9543 sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe sleep_before_teardown: 0 subset: 111/12000 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQBHS/YCkprHvrURc0T4/2aDuLdCy8qUyqDYAc7KrJleX5+zwSGWZFSBH1IKD+3+HsJLWXsbri5WgOTRUvbtjw= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlPHOv6p5VaKvmRzZSAowT6fF1TAUztcdWUe8Re0wnn0ED6wT9Ew5Og+Fvnc34P6v0mIISXY8eiDsXaoMhhoHQ= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyNra49sqNfE5JtecpgVnnD0W7aNE2VivweYAVTC02O/J6A1juzldgIkYHaS7Aa4syjYVS55LVXI4yDiN8JMB0= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0LdHkJ32dDApuGXu3KyH+/tCuOfSVpKJ7fnTRROW7N40indaSRMfXoBxvzOI+X/s+Ld8vzHPaesXljpAu5kek= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsx.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-18_13:54:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-19T00:27:32.433 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa; will attempt to use it 2023-11-19T00:27:32.433 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks 2023-11-19T00:27:32.434 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-19T00:27:32.435 INFO:teuthology.task.internal:Checking packages... 2023-11-19T00:27:32.457 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe' 2023-11-19T00:27:32.457 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-19T00:27:32.457 INFO:teuthology.packaging:ref: None 2023-11-19T00:27:32.457 INFO:teuthology.packaging:tag: None 2023-11-19T00:27:32.457 INFO:teuthology.packaging:branch: main 2023-11-19T00:27:32.457 INFO:teuthology.packaging:sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:27:32.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-19T00:27:32.714 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7426.g35dfedef 2023-11-19T00:27:32.714 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-19T00:27:32.720 INFO:teuthology.task.internal:no buildpackages task found 2023-11-19T00:27:32.720 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-19T00:27:32.725 INFO:teuthology.task.internal:Saving configuration 2023-11-19T00:27:32.737 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-19T00:27:32.743 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-19T00:27:32.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.054316', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQBHS/YCkprHvrURc0T4/2aDuLdCy8qUyqDYAc7KrJleX5+zwSGWZFSBH1IKD+3+HsJLWXsbri5WgOTRUvbtjw='} 2023-11-19T00:27:32.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.056324', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlPHOv6p5VaKvmRzZSAowT6fF1TAUztcdWUe8Re0wnn0ED6wT9Ew5Og+Fvnc34P6v0mIISXY8eiDsXaoMhhoHQ='} 2023-11-19T00:27:32.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.059671', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyNra49sqNfE5JtecpgVnnD0W7aNE2VivweYAVTC02O/J6A1juzldgIkYHaS7Aa4syjYVS55LVXI4yDiN8JMB0='} 2023-11-19T00:27:32.831 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.058164', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0LdHkJ32dDApuGXu3KyH+/tCuOfSVpKJ7fnTRROW7N40indaSRMfXoBxvzOI+X/s+Ld8vzHPaesXljpAu5kek='} 2023-11-19T00:27:32.831 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-19T00:27:32.838 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2023-11-19T00:27:32.838 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['osd.0'] 2023-11-19T00:27:32.838 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['osd.1'] 2023-11-19T00:27:32.838 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['osd.2'] 2023-11-19T00:27:32.838 INFO:teuthology.run_tasks:Running task console_log... 2023-11-19T00:27:32.963 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f73e2d50f70>, signals=[15]) 2023-11-19T00:27:32.963 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-19T00:27:32.970 INFO:teuthology.task.internal:Opening connections... 2023-11-19T00:27:32.970 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2023-11-19T00:27:32.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:27:33.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-11-19T00:27:33.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:27:33.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2023-11-19T00:27:33.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:27:33.244 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2023-11-19T00:27:33.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:27:33.327 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-19T00:27:33.334 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-11-19T00:27:33.354 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-11-19T00:27:33.354 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-11-19T00:27:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2023-11-19T00:27:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2023-11-19T00:27:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2023-11-19T00:27:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2023-11-19T00:27:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2023-11-19T00:27:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T00:27:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T00:27:33.417 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-11-19T00:27:33.437 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-11-19T00:27:33.455 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-11-19T00:27:33.455 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-19T00:27:33.512 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-11-19T00:27:33.512 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2023-11-19T00:27:33.512 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-11-19T00:27:33.512 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-11-19T00:27:33.512 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T00:27:33.513 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T00:27:33.513 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-19T00:27:33.537 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-11-19T00:27:33.554 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-11-19T00:27:33.554 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-11-19T00:27:33.611 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-11-19T00:27:33.611 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2023-11-19T00:27:33.611 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-11-19T00:27:33.611 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T00:27:33.612 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T00:27:33.612 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-11-19T00:27:33.637 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-11-19T00:27:33.654 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-11-19T00:27:33.654 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-11-19T00:27:33.710 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-11-19T00:27:33.710 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2023-11-19T00:27:33.710 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T00:27:33.711 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T00:27:33.712 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-11-19T00:27:33.728 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-19T00:27:33.737 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-19T00:27:33.741 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-19T00:27:33.742 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2023-11-19T00:27:33.744 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-11-19T00:27:33.746 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2023-11-19T00:27:33.749 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2023-11-19T00:27:33.767 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-19T00:27:33.774 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-19T00:27:33.774 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2023-11-19T00:27:33.805 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-11-19T00:27:33.807 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2023-11-19T00:27:33.810 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2023-11-19T00:27:33.886 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-19T00:27:33.982 INFO:teuthology.run_tasks:Running task kernel... 2023-11-19T00:27:33.997 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-19T00:27:33.997 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-19T00:27:33.997 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-19T00:27:33.998 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-19T00:27:33.998 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-19T00:27:33.998 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-19T00:27:34.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:27:34.015 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2023-11-19T00:27:34.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:27:34.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:27:34.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:27:34.018 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-11-19T00:27:34.018 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2023-11-19T00:27:34.018 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-11-19T00:27:34.072 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-361.el9.x86_64 2023-11-19T00:27:34.072 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-361.el9.x86_64 2023-11-19T00:27:34.072 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2023-11-19T00:27:34.074 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-361.el9.x86_64 2023-11-19T00:27:34.075 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-361.el9.x86_64 2023-11-19T00:27:34.075 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2023-11-19T00:27:34.076 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-361.el9.x86_64 2023-11-19T00:27:34.076 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-361.el9.x86_64 2023-11-19T00:27:34.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2023-11-19T00:27:34.078 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-361.el9.x86_64 2023-11-19T00:27:34.078 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-361.el9.x86_64 2023-11-19T00:27:34.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2023-11-19T00:27:36.320 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-11-19T00:27:36.343 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-11-19T00:27:36.352 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-11-19T00:27:36.353 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 9.7 MB/s | 6.4 MB 00:00 2023-11-19T00:27:37.844 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-11-19T00:27:37.853 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2023-11-19T00:27:37.945 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2023-11-19T00:27:38.053 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2023-11-19T00:27:38.601 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-11-19T00:27:38.853 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-11-19T00:27:39.493 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 7.9 MB 00:01 2023-11-19T00:27:40.535 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-11-19T00:27:40.629 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 29 MB/s | 18 MB 00:00 2023-11-19T00:27:41.420 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-11-19T00:27:41.827 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-11-19T00:27:43.879 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-11-19T00:27:45.013 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 5.8 MB 00:00 2023-11-19T00:27:46.446 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 15 kB 00:00 2023-11-19T00:27:46.548 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 5.8 MB 00:01 2023-11-19T00:27:46.726 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 5.8 MB 00:02 2023-11-19T00:27:47.963 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2023-11-19T00:27:48.010 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 15 kB 00:00 2023-11-19T00:27:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-11-19T00:27:50.284 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 20 MB 00:03 2023-11-19T00:27:51.800 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 20 MB 00:03 2023-11-19T00:27:52.062 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 5.8 MB 00:04 2023-11-19T00:27:53.537 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2023-11-19T00:27:54.561 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-11-19T00:27:55.022 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-11-19T00:27:55.197 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-19T00:27:56.505 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-11-19T00:27:56.901 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-19T00:27:56.901 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-19T00:27:56.994 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-11-19T00:27:57.001 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-11-19T00:27:57.001 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-384.el9 CentOS-BaseOS 5.5 M 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-384.el9 CentOS-BaseOS 20 M 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-384.el9 CentOS-BaseOS 38 M 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-384.el9 CentOS-BaseOS 32 M 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-11-19T00:27:57.002 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2023-11-19T00:27:57.003 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:27:57.003 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 95 M 2023-11-19T00:27:57.003 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 121 M 2023-11-19T00:27:57.003 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-11-19T00:27:57.238 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-384.el9.x86_64.rpm 23 MB/s | 5.5 MB 00:00 2023-11-19T00:27:57.488 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-core-5.14.0-384.el9.x86_64.rpm 42 MB/s | 20 MB 00:00 2023-11-19T00:27:57.629 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-19T00:27:57.630 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-19T00:27:57.721 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-11-19T00:27:57.725 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2023-11-19T00:27:57.725 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2023-11-19T00:27:57.725 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2023-11-19T00:27:57.725 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-384.el9 CentOS-BaseOS 5.5 M 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-384.el9 CentOS-BaseOS 20 M 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-384.el9 CentOS-BaseOS 38 M 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-384.el9 CentOS-BaseOS 32 M 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2023-11-19T00:27:57.726 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:27:57.727 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 95 M 2023-11-19T00:27:57.727 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 121 M 2023-11-19T00:27:57.727 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2023-11-19T00:27:57.863 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-modules-core-5.14.0-384.el9.x86_6 52 MB/s | 32 MB 00:00 2023-11-19T00:27:57.991 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-384.el9.x86_64.rpm 21 MB/s | 5.5 MB 00:00 2023-11-19T00:27:58.233 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-384.el9.x86_64.rpm 40 MB/s | 20 MB 00:00 2023-11-19T00:27:58.246 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-modules-5.14.0-384.el9.x86_64.rpm 30 MB/s | 38 MB 00:01 2023-11-19T00:27:58.249 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:27:58.250 INFO:teuthology.orchestra.run.smithi099.stdout:Total 77 MB/s | 95 MB 00:01 2023-11-19T00:27:58.250 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-11-19T00:27:58.623 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-11-19T00:27:58.623 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-11-19T00:27:58.649 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-5.14.0-384.el9.x86_64.rpm 41 MB/s | 38 MB 00:00 2023-11-19T00:27:58.795 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-19T00:27:58.795 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-19T00:27:58.886 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-384.el9 CentOS-BaseOS 5.5 M 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-384.el9 CentOS-BaseOS 20 M 2023-11-19T00:27:58.892 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-384.el9 CentOS-BaseOS 38 M 2023-11-19T00:27:58.893 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-384.el9 CentOS-BaseOS 32 M 2023-11-19T00:27:58.893 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:27:58.893 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-11-19T00:27:58.893 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-11-19T00:27:58.893 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2023-11-19T00:27:58.893 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:27:58.893 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 95 M 2023-11-19T00:27:58.894 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 121 M 2023-11-19T00:27:58.894 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-11-19T00:27:58.950 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-core-5.14.0-384.el9.x86_6 34 MB/s | 32 MB 00:00 2023-11-19T00:27:58.953 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:27:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:Total 78 MB/s | 95 MB 00:01 2023-11-19T00:27:58.954 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2023-11-19T00:27:59.123 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-384.el9.x86_64.rpm 24 MB/s | 5.5 MB 00:00 2023-11-19T00:27:59.385 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2023-11-19T00:27:59.386 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2023-11-19T00:27:59.390 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-384.el9.x86_64.rpm 41 MB/s | 20 MB 00:00 2023-11-19T00:27:59.627 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-11-19T00:27:59.627 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-11-19T00:27:59.748 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-core-5.14.0-384.el9.x86_6 52 MB/s | 32 MB 00:00 2023-11-19T00:27:59.880 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-11-19T00:28:00.107 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-5.14.0-384.el9.x86_64.rpm 31 MB/s | 38 MB 00:01 2023-11-19T00:28:00.110 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:28:00.110 INFO:teuthology.orchestra.run.smithi073.stdout:Total 78 MB/s | 95 MB 00:01 2023-11-19T00:28:00.111 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-11-19T00:28:00.404 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2023-11-19T00:28:00.405 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2023-11-19T00:28:00.483 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-11-19T00:28:00.483 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-11-19T00:28:01.472 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-11-19T00:28:01.472 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-11-19T00:28:01.986 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-11-19T00:28:02.195 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-19T00:28:02.195 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-19T00:28:02.292 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-384.el9 CentOS-BaseOS 5.5 M 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-384.el9 CentOS-BaseOS 20 M 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-384.el9 CentOS-BaseOS 38 M 2023-11-19T00:28:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-384.el9 CentOS-BaseOS 32 M 2023-11-19T00:28:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:28:02.298 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2023-11-19T00:28:02.298 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2023-11-19T00:28:02.298 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2023-11-19T00:28:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:28:02.298 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 95 M 2023-11-19T00:28:02.299 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 121 M 2023-11-19T00:28:02.299 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2023-11-19T00:28:02.531 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-384.el9.x86_64.rpm 23 MB/s | 5.5 MB 00:00 2023-11-19T00:28:02.626 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:02.755 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:02.790 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-5.14.0-384.el9.x86_64.rpm 41 MB/s | 20 MB 00:00 2023-11-19T00:28:02.913 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2023-11-19T00:28:03.148 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-core-5.14.0-384.el9.x86_6 53 MB/s | 32 MB 00:00 2023-11-19T00:28:03.507 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-5.14.0-384.el9.x86_64.rpm 31 MB/s | 38 MB 00:01 2023-11-19T00:28:03.510 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:28:03.510 INFO:teuthology.orchestra.run.smithi181.stdout:Total 79 MB/s | 95 MB 00:01 2023-11-19T00:28:03.510 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2023-11-19T00:28:03.589 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:03.724 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-11-19T00:28:03.872 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2023-11-19T00:28:03.872 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2023-11-19T00:28:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:04.607 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:04.867 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2023-11-19T00:28:04.868 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2023-11-19T00:28:05.492 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:05.669 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:06.655 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:06.833 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:07.221 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2023-11-19T00:28:07.350 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:07.525 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:08.057 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:10.260 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:10.371 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:10.976 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:11.803 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:11.902 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:12.110 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:12.218 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:14.958 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:15.563 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:16.825 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:16.904 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:20.314 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:43.795 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:43.838 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:44.196 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-384.el9.x86_64 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:44.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:28:44.633 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-11-19T00:28:45.169 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:45.310 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:45.311 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:45.311 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-384.el9.x86_64 2023-11-19T00:28:45.311 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-19T00:28:45.311 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-19T00:28:45.311 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2023-11-19T00:28:45.311 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2023-11-19T00:28:45.311 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:45.416 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:45.416 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:45.416 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2023-11-19T00:28:45.450 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2023-11-19T00:28:45.450 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2023-11-19T00:28:45.450 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2023-11-19T00:28:45.450 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 68.el9 2023-11-19T00:28:45.450 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8264254 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-19T00:28:45.451 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:28:45.452 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2023-11-19T00:28:45.453 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-19T00:28:45.453 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-384.el9.x86_64 2023-11-19T00:28:45.453 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-19T00:28:46.045 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2023-11-19T00:28:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:46.540 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:46.540 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:46.540 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:46.540 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:46.932 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-384.el9.x86_64 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:28:46.933 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-11-19T00:28:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:47.465 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-19T00:28:47.549 INFO:teuthology.orchestra.run.smithi099.stderr:done 2023-11-19T00:28:47.558 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-11-19T00:28:47.573 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.iQ49KUPZHU 2023-11-19T00:28:47.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iQ49KUPZHU 2023-11-19T00:28:47.600 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:47.600 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:47.601 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-384.el9.x86_64 2023-11-19T00:28:47.601 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-19T00:28:47.601 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-19T00:28:47.601 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2023-11-19T00:28:47.601 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2023-11-19T00:28:47.601 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:47.642 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.iQ49KUPZHU 2023-11-19T00:28:47.704 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:47.705 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:47.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2023-11-19T00:28:47.739 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2023-11-19T00:28:47.739 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2023-11-19T00:28:47.739 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 68.el9 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8264254 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2023-11-19T00:28:47.740 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:28:47.741 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2023-11-19T00:28:47.742 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-19T00:28:47.742 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-384.el9.x86_64 2023-11-19T00:28:47.742 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-19T00:28:47.781 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.iQ49KUPZHU is 6KB 2023-11-19T00:28:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:47.830 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.iQ49KUPZHU 2023-11-19T00:28:47.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2023-11-19T00:28:47.908 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-19T00:28:47.908 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-19T00:28:47.909 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-19T00:28:47.909 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64.conf 2023-11-19T00:28:47.910 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64 2023-11-19T00:28:48.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-384.el9.x86_64 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:28:48.205 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-11-19T00:28:48.347 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-11-19T00:28:48.707 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:48.839 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:48.839 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:48.839 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-384.el9.x86_64 2023-11-19T00:28:48.839 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-19T00:28:48.839 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-19T00:28:48.840 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-19T00:28:48.840 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2023-11-19T00:28:48.840 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:48.949 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:48.949 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:48.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2023-11-19T00:28:48.992 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2023-11-19T00:28:48.992 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-19T00:28:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2023-11-19T00:28:48.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:28:48.995 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2023-11-19T00:28:48.995 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-19T00:28:48.996 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-384.el9.x86_64 2023-11-19T00:28:48.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-19T00:28:49.162 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:49.564 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:49.565 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-384.el9.x86_64 1/4 2023-11-19T00:28:49.565 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-384.el9.x86_64 2/4 2023-11-19T00:28:49.565 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-384.el9.x86_64 3/4 2023-11-19T00:28:49.634 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2023-11-19T00:28:49.760 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-19T00:28:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-11-19T00:28:49.783 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-11-19T00:28:49.798 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.KChXgGgY6c 2023-11-19T00:28:49.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KChXgGgY6c 2023-11-19T00:28:49.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.KChXgGgY6c 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-384.el9.x86_64 4/4 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-384.el9.x86_64 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-384.el9.x86_64 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:28:50.001 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2023-11-19T00:28:50.010 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.KChXgGgY6c is 6KB 2023-11-19T00:28:50.058 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.KChXgGgY6c 2023-11-19T00:28:50.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2023-11-19T00:28:50.136 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-19T00:28:50.137 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-19T00:28:50.137 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-19T00:28:50.137 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64.conf 2023-11-19T00:28:50.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64 2023-11-19T00:28:50.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2023-11-19T00:28:50.504 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:50.632 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:50.632 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-384.el9.x86_64 2023-11-19T00:28:50.632 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-19T00:28:50.633 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-19T00:28:50.633 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2023-11-19T00:28:50.633 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2023-11-19T00:28:50.633 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2023-11-19T00:28:50.737 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-384.el9.x86_64 2023-11-19T00:28:50.738 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-384.el9.x86_64 2023-11-19T00:28:50.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2023-11-19T00:28:50.774 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 68.el9 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8264254 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-19T00:28:50.775 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2023-11-19T00:28:50.776 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:28:50.777 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2023-11-19T00:28:50.777 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-19T00:28:50.777 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-384.el9.x86_64 2023-11-19T00:28:50.778 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-19T00:28:51.241 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30320]) leaked on vgs invocation. Parent PID 18224: grub2-probe 2023-11-19T00:28:51.241 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[43057]) leaked on vgs invocation. Parent PID 18224: grub2-probe 2023-11-19T00:28:51.283 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[30320]) leaked on vgs invocation. Parent PID 18224: grub2-probe 2023-11-19T00:28:51.283 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[43057]) leaked on vgs invocation. Parent PID 18224: grub2-probe 2023-11-19T00:28:51.403 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2023-11-19T00:28:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-19T00:28:51.460 INFO:teuthology.orchestra.run.smithi046.stderr:done 2023-11-19T00:28:51.462 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-11-19T00:28:51.478 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.OkBfxSixJm 2023-11-19T00:28:51.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OkBfxSixJm 2023-11-19T00:28:51.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.OkBfxSixJm 2023-11-19T00:28:51.677 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.OkBfxSixJm is 6KB 2023-11-19T00:28:51.724 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.OkBfxSixJm 2023-11-19T00:28:51.738 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2023-11-19T00:28:51.813 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-19T00:28:51.813 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-19T00:28:51.813 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-19T00:28:51.814 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64.conf 2023-11-19T00:28:51.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64 2023-11-19T00:28:51.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2023-11-19T00:28:52.745 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-19T00:28:52.782 INFO:teuthology.orchestra.run.smithi181.stderr:done 2023-11-19T00:28:52.784 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2023-11-19T00:28:52.800 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.QqGm3PEoQW 2023-11-19T00:28:52.800 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QqGm3PEoQW 2023-11-19T00:28:52.868 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.QqGm3PEoQW 2023-11-19T00:28:53.006 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.QqGm3PEoQW is 6KB 2023-11-19T00:28:53.026 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.QqGm3PEoQW 2023-11-19T00:28:53.039 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2023-11-19T00:28:53.104 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-19T00:28:53.104 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-19T00:28:53.104 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-19T00:28:53.104 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64.conf 2023-11-19T00:28:53.105 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-384.el9.x86_64 2023-11-19T00:28:53.290 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2023-11-19T00:29:18.062 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2023-11-19T00:29:18.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-19T00:29:18.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:20.302 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2023-11-19T00:29:20.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-19T00:29:20.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:21.978 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-19T00:29:21.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-19T00:29:21.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:23.294 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2023-11-19T00:29:23.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-19T00:29:23.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:36.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-19T00:29:38.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-19T00:29:40.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-19T00:29:41.858 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-19T00:29:45.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-19T00:29:45.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:47.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-19T00:29:47.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:48.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-11-19T00:29:49.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-19T00:29:49.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:50.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-19T00:29:50.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-19T00:29:50.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:29:52.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-19T00:29:53.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-19T00:30:00.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-19T00:30:00.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:30:02.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-19T00:30:02.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:30:04.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-19T00:30:04.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:30:05.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-19T00:30:05.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:30:21.282 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-19T00:30:22.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-19T00:30:24.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-11-19T00:30:32.570 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-11-19T00:30:33.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-19T00:30:33.073 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-384.el9.x86_64"... 2023-11-19T00:30:33.073 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2023-11-19T00:30:33.097 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-384.el9.x86_64 2023-11-19T00:30:33.097 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-384.el9.x86_64 vs 5.14.0-384.el9.x86_64 2023-11-19T00:30:33.097 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-19T00:30:33.098 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-19T00:30:34.099 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2023-11-19T00:30:34.099 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-19T00:30:34.172 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2023-11-19T00:30:34.381 DEBUG:teuthology.parallel:result is None 2023-11-19T00:30:36.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-19T00:30:36.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:30:36.664 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-11-19T00:30:37.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-19T00:30:37.070 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-384.el9.x86_64"... 2023-11-19T00:30:37.070 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-11-19T00:30:37.084 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-384.el9.x86_64 2023-11-19T00:30:37.084 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-384.el9.x86_64 vs 5.14.0-384.el9.x86_64 2023-11-19T00:30:37.084 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-19T00:30:37.084 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-19T00:30:37.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-19T00:30:37.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:30:38.085 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2023-11-19T00:30:38.086 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-19T00:30:38.158 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2023-11-19T00:30:38.194 DEBUG:teuthology.parallel:result is None 2023-11-19T00:30:38.254 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-11-19T00:30:38.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-19T00:30:38.663 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-384.el9.x86_64"... 2023-11-19T00:30:38.663 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-11-19T00:30:38.678 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-384.el9.x86_64 2023-11-19T00:30:38.678 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-384.el9.x86_64 vs 5.14.0-384.el9.x86_64 2023-11-19T00:30:38.678 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-19T00:30:38.678 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-19T00:30:39.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-19T00:30:39.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:30:39.679 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-19T00:30:39.679 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-19T00:30:39.734 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-11-19T00:30:39.754 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2023-11-19T00:30:39.784 DEBUG:teuthology.parallel:result is None 2023-11-19T00:30:40.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-19T00:30:40.116 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-384.el9.x86_64"... 2023-11-19T00:30:40.116 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2023-11-19T00:30:40.129 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-384.el9.x86_64 2023-11-19T00:30:40.130 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-384.el9.x86_64 vs 5.14.0-384.el9.x86_64 2023-11-19T00:30:40.130 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-19T00:30:40.130 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-19T00:30:41.131 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2023-11-19T00:30:41.131 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-19T00:30:41.204 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2023-11-19T00:30:41.241 DEBUG:teuthology.parallel:result is None 2023-11-19T00:30:41.242 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-19T00:30:41.249 INFO:teuthology.task.internal:Creating test directory... 2023-11-19T00:30:41.249 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-19T00:30:41.251 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-19T00:30:41.253 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-19T00:30:41.256 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-19T00:30:41.271 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-19T00:30:41.276 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-19T00:30:41.285 INFO:teuthology.task.internal:Creating archive directory... 2023-11-19T00:30:41.285 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-19T00:30:41.307 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-19T00:30:41.311 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-19T00:30:41.314 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-19T00:30:41.412 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-19T00:30:41.421 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-19T00:30:41.421 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-19T00:30:41.423 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-19T00:30:41.426 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-19T00:30:41.428 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-19T00:30:41.452 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.465 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.468 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.479 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.595 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.609 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.676 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.690 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-19T00:30:41.692 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-19T00:30:41.699 INFO:teuthology.task.internal:Configuring sudo... 2023-11-19T00:30:41.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-19T00:30:41.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-19T00:30:41.703 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-19T00:30:41.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-19T00:30:41.735 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-19T00:30:41.743 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-19T00:30:41.744 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-19T00:30:41.773 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-19T00:30:41.776 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-19T00:30:41.779 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-19T00:30:41.794 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:41.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:41.939 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.067 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:30:42.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-19T00:30:42.138 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:42.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:42.263 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.381 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:30:42.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-19T00:30:42.469 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:42.515 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:42.572 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.700 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:30:42.700 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-19T00:30:42.769 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:42.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-19T00:30:42.866 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.947 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-19T00:30:42.990 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:30:42.990 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-19T00:30:43.057 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2023-11-19T00:30:43.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-11-19T00:30:43.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2023-11-19T00:30:43.064 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2023-11-19T00:30:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:30:43.141 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:30:43.251 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:30:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:30:43.793 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-19T00:30:43.800 INFO:teuthology.task.internal:Starting timer... 2023-11-19T00:30:43.801 INFO:teuthology.run_tasks:Running task pcp... 2023-11-19T00:30:43.810 INFO:teuthology.run_tasks:Running task selinux... 2023-11-19T00:30:43.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2023-11-19T00:30:43.927 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2023-11-19T00:30:43.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2023-11-19T00:30:43.985 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2023-11-19T00:30:43.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2023-11-19T00:30:44.063 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2023-11-19T00:30:44.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2023-11-19T00:30:44.122 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2023-11-19T00:30:44.123 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-19T00:30:44.124 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2023-11-19T00:30:44.141 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2023-11-19T00:30:44.141 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2023-11-19T00:30:44.167 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2023-11-19T00:30:44.167 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2023-11-19T00:30:44.189 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2023-11-19T00:30:44.190 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2023-11-19T00:30:44.214 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2023-11-19T00:30:44.214 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2023-11-19T00:30:44.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:30:44.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:30:44.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:30:44.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:30:44.275 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:30:44.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:30:44.305 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:30:44.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:30:44.332 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-19T00:30:44.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2023-11-19T00:30:44.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2023-11-19T00:30:44.510 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2023-11-19T00:30:44.541 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2023-11-19T00:30:44.574 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-19T00:30:44.583 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-19T00:30:44.589 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-19T00:30:44.727 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-19T00:30:44.744 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-19T00:30:44.745 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi073.front.sepia.ceph.com,smithi099.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-19T00:36:22.571 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2023-11-19T00:36:22.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-19T00:36:22.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:36:22.671 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-11-19T00:36:22.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-19T00:36:22.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-19T00:36:22.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:36:22.824 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-11-19T00:36:22.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-19T00:36:22.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-19T00:36:22.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:36:22.986 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-11-19T00:36:23.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-11-19T00:36:23.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-19T00:36:23.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T00:36:23.145 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-11-19T00:36:23.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-11-19T00:36:23.220 INFO:teuthology.run_tasks:Running task clock... 2023-11-19T00:36:23.235 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-19T00:36:23.235 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-19T00:36:23.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:36:23.239 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-19T00:36:23.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:36:23.242 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-19T00:36:23.242 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:36:23.244 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-19T00:36:23.244 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:36:23.272 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-19T00:36:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-19T00:36:23.277 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-19T00:36:23.290 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-19T00:36:23.292 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-19T00:36:23.295 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-19T00:36:23.296 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-19T00:36:23.311 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-19T00:36:23.319 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2023-11-19T00:36:23.327 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2023-11-19T00:36:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2023-11-19T00:36:23.333 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2023-11-19T00:36:23.341 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2023-11-19T00:36:23.341 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2023-11-19T00:36:23.349 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2023-11-19T00:36:23.350 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-19T00:36:23.355 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2023-11-19T00:36:23.358 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-19T00:36:23.366 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-19T00:36:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-19T00:36:23.371 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-19T00:36:23.374 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-19T00:36:23.387 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-19T00:36:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-19T00:36:23.409 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:36:23.412 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:36:23.412 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-11-19T00:36:23.412 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.412 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.412 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.413 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.418 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:36:23.421 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:36:23.421 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-11-19T00:36:23.421 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.421 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.422 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.422 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:36:23.434 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:36:23.435 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2023-11-19T00:36:23.435 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.435 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.435 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.435 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.436 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:36:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:36:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-11-19T00:36:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:36:23.441 INFO:teuthology.run_tasks:Running task install... 2023-11-19T00:36:23.451 DEBUG:teuthology.task.install:project ceph 2023-11-19T00:36:23.451 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}} 2023-11-19T00:36:23.451 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'} 2023-11-19T00:36:23.451 INFO:teuthology.task.install:Using flavor: default 2023-11-19T00:36:23.459 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-19T00:36:23.459 INFO:teuthology.task.install:extra packages: [] 2023-11-19T00:36:23.460 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-19T00:36:23.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:36:23.463 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-19T00:36:23.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:36:23.464 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-19T00:36:23.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:36:23.466 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-19T00:36:23.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:36:23.615 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-19T00:36:23.615 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-19T00:36:23.628 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-19T00:36:23.628 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-19T00:36:23.684 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-19T00:36:23.684 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-19T00:36:23.693 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-19T00:36:23.693 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-19T00:36:23.742 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-19T00:36:23.742 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:36:23.742 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-19T00:36:23.751 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-19T00:36:23.751 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:36:23.752 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-19T00:36:23.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-19T00:36:23.774 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-19T00:36:23.779 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-19T00:36:23.780 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-19T00:36:23.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-19T00:36:23.848 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-19T00:36:23.856 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-19T00:36:23.857 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:36:23.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-19T00:36:23.869 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-19T00:36:23.869 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:36:23.869 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-19T00:36:23.885 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-19T00:36:23.885 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-19T00:36:23.897 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-19T00:36:23.898 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-19T00:36:23.926 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-19T00:36:23.935 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-19T00:36:23.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-19T00:36:23.964 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2023-11-19T00:36:23.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2023-11-19T00:36:23.967 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-19T00:36:23.992 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2023-11-19T00:36:23.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2023-11-19T00:36:24.034 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-19T00:36:24.047 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-19T00:36:24.101 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2023-11-19T00:36:24.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2023-11-19T00:36:24.113 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2023-11-19T00:36:24.114 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2023-11-19T00:36:24.231 INFO:teuthology.orchestra.run.smithi099.stdout:72 files removed 2023-11-19T00:36:24.237 INFO:teuthology.orchestra.run.smithi046.stdout:72 files removed 2023-11-19T00:36:24.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-19T00:36:24.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-19T00:36:24.333 INFO:teuthology.orchestra.run.smithi073.stdout:72 files removed 2023-11-19T00:36:24.356 INFO:teuthology.orchestra.run.smithi181.stdout:72 files removed 2023-11-19T00:36:24.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-19T00:36:24.383 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-19T00:36:24.901 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 236 kB/s | 78 kB 00:00 2023-11-19T00:36:25.013 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 191 kB/s | 78 kB 00:00 2023-11-19T00:36:25.119 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 176 kB/s | 78 kB 00:00 2023-11-19T00:36:25.170 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 167 kB/s | 78 kB 00:00 2023-11-19T00:36:25.343 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 24 kB/s | 9.5 kB 00:00 2023-11-19T00:36:25.439 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-11-19T00:36:25.486 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 30 kB/s | 9.5 kB 00:00 2023-11-19T00:36:25.596 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-11-19T00:36:25.694 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-11-19T00:36:25.806 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2023-11-19T00:36:25.920 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2023-11-19T00:36:25.988 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2023-11-19T00:36:26.241 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-11-19T00:36:26.271 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-11-19T00:36:26.323 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-11-19T00:36:26.391 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-11-19T00:36:27.806 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-11-19T00:36:27.817 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2023-11-19T00:36:27.821 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2023-11-19T00:36:28.016 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-11-19T00:36:28.647 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-19T00:36:28.848 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 7.9 MB 00:00 2023-11-19T00:36:28.983 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 7.9 MB 00:00 2023-11-19T00:36:30.775 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 28 MB/s | 18 MB 00:00 2023-11-19T00:36:30.862 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 7.9 MB 00:02 2023-11-19T00:36:30.932 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 15 MB/s | 18 MB 00:01 2023-11-19T00:36:32.116 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 18 MB 00:02 2023-11-19T00:36:32.704 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 25 MB/s | 18 MB 00:00 2023-11-19T00:36:35.425 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 5.8 MB 00:01 2023-11-19T00:36:36.177 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.8 MB 00:01 2023-11-19T00:36:36.447 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 15 MB/s | 5.8 MB 00:00 2023-11-19T00:36:37.350 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-11-19T00:36:37.491 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 5.8 MB 00:02 2023-11-19T00:36:37.786 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2023-11-19T00:36:38.039 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2023-11-19T00:36:38.821 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-11-19T00:36:38.978 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-11-19T00:36:39.343 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 15 kB 00:00 2023-11-19T00:36:40.051 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2023-11-19T00:36:41.205 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-11-19T00:36:43.485 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2023-11-19T00:36:43.987 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2023-11-19T00:36:44.698 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-11-19T00:36:45.927 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-11-19T00:36:46.148 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:46.149 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:46.224 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-19T00:36:46.234 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-19T00:36:46.235 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-19T00:36:46.236 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-19T00:36:46.237 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-19T00:36:46.238 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-19T00:36:46.239 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-19T00:36:46.240 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-19T00:36:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-19T00:36:46.242 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-19T00:36:46.243 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-19T00:36:46.244 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-19T00:36:46.245 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:Install 125 Packages 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 5 Packages 2023-11-19T00:36:46.246 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:36:46.247 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 186 M 2023-11-19T00:36:46.247 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-11-19T00:36:46.733 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:46.733 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:46.795 INFO:teuthology.orchestra.run.smithi073.stdout:(1/130): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-11-19T00:36:46.814 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-11-19T00:36:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2023-11-19T00:36:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2023-11-19T00:36:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2023-11-19T00:36:46.829 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2023-11-19T00:36:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-19T00:36:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-19T00:36:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-19T00:36:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-19T00:36:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-19T00:36:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-19T00:36:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-19T00:36:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-19T00:36:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-19T00:36:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-19T00:36:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-19T00:36:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-19T00:36:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:36:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-11-19T00:36:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2023-11-19T00:36:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:Install 125 Packages 2023-11-19T00:36:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 5 Packages 2023-11-19T00:36:46.842 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:36:46.842 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 186 M 2023-11-19T00:36:46.843 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2023-11-19T00:36:46.995 INFO:teuthology.orchestra.run.smithi073.stdout:(2/130): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 10 MB/s | 5.2 MB 00:00 2023-11-19T00:36:47.045 INFO:teuthology.orchestra.run.smithi073.stdout:(3/130): ceph-immutable-object-cache-18.0.0-741 2.8 MB/s | 141 kB 00:00 2023-11-19T00:36:47.171 INFO:teuthology.orchestra.run.smithi073.stdout:(4/130): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 17 MB/s | 2.1 MB 00:00 2023-11-19T00:36:47.279 INFO:teuthology.orchestra.run.smithi073.stdout:(5/130): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 14 MB/s | 1.5 MB 00:00 2023-11-19T00:36:47.378 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:47.379 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:47.457 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-11-19T00:36:47.477 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2023-11-19T00:36:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-11-19T00:36:47.477 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2023-11-19T00:36:47.477 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-11-19T00:36:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-19T00:36:47.477 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-19T00:36:47.478 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-19T00:36:47.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-19T00:36:47.480 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-19T00:36:47.481 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-19T00:36:47.482 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-19T00:36:47.483 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-19T00:36:47.484 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-19T00:36:47.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-19T00:36:47.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-19T00:36:47.487 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout:Install 125 Packages 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 5 Packages 2023-11-19T00:36:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:36:47.489 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 186 M 2023-11-19T00:36:47.489 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-11-19T00:36:47.521 INFO:teuthology.orchestra.run.smithi046.stdout:(1/130): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2023-11-19T00:36:47.538 INFO:teuthology.orchestra.run.smithi073.stdout:(6/130): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 17 MB/s | 4.4 MB 00:00 2023-11-19T00:36:47.565 INFO:teuthology.orchestra.run.smithi073.stdout:(7/130): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.1 MB/s | 860 kB 00:00 2023-11-19T00:36:48.149 INFO:teuthology.orchestra.run.smithi099.stdout:(1/130): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-11-19T00:36:48.180 INFO:teuthology.orchestra.run.smithi046.stdout:(2/130): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.3 MB/s | 860 kB 00:00 2023-11-19T00:36:48.305 INFO:teuthology.orchestra.run.smithi046.stdout:(3/130): ceph-immutable-object-cache-18.0.0-741 1.1 MB/s | 141 kB 00:00 2023-11-19T00:36:48.516 INFO:teuthology.orchestra.run.smithi099.stdout:(2/130): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 2.3 MB/s | 860 kB 00:00 2023-11-19T00:36:48.567 INFO:teuthology.orchestra.run.smithi099.stdout:(3/130): ceph-immutable-object-cache-18.0.0-741 2.7 MB/s | 141 kB 00:00 2023-11-19T00:36:48.589 INFO:teuthology.orchestra.run.smithi073.stdout:(8/130): ceph-osd-18.0.0-7418.gb0f45a51.el9.x86 17 MB/s | 18 MB 00:01 2023-11-19T00:36:48.598 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:48.599 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-19T00:36:48.655 INFO:teuthology.orchestra.run.smithi073.stdout:(9/130): ceph-selinux-18.0.0-7418.gb0f45a51.el9 362 kB/s | 24 kB 00:00 2023-11-19T00:36:48.674 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-19T00:36:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-19T00:36:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-19T00:36:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-19T00:36:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-19T00:36:48.688 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-19T00:36:48.689 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-19T00:36:48.690 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-19T00:36:48.691 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-19T00:36:48.692 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-19T00:36:48.693 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-19T00:36:48.694 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================================ 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout:Install 125 Packages 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 5 Packages 2023-11-19T00:36:48.695 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:36:48.696 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 186 M 2023-11-19T00:36:48.696 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2023-11-19T00:36:48.942 INFO:teuthology.orchestra.run.smithi099.stdout:(4/130): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 5.6 MB/s | 2.1 MB 00:00 2023-11-19T00:36:49.080 INFO:teuthology.orchestra.run.smithi046.stdout:(4/130): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 2.7 MB/s | 2.1 MB 00:00 2023-11-19T00:36:49.425 INFO:teuthology.orchestra.run.smithi099.stdout:(5/130): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 3.0 MB/s | 1.5 MB 00:00 2023-11-19T00:36:49.603 INFO:teuthology.orchestra.run.smithi181.stdout:(1/130): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 16 kB/s | 6.5 kB 00:00 2023-11-19T00:36:49.881 INFO:teuthology.orchestra.run.smithi046.stdout:(5/130): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 1.8 MB/s | 1.5 MB 00:00 2023-11-19T00:36:50.570 INFO:teuthology.orchestra.run.smithi181.stdout:(2/130): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 889 kB/s | 860 kB 00:00 2023-11-19T00:36:50.762 INFO:teuthology.orchestra.run.smithi181.stdout:(3/130): ceph-immutable-object-cache-18.0.0-741 735 kB/s | 141 kB 00:00 2023-11-19T00:36:51.047 INFO:teuthology.orchestra.run.smithi046.stdout:(6/130): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 1.4 MB/s | 5.2 MB 00:03 2023-11-19T00:36:51.067 INFO:teuthology.orchestra.run.smithi099.stdout:(6/130): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 2.7 MB/s | 4.4 MB 00:01 2023-11-19T00:36:51.676 INFO:teuthology.orchestra.run.smithi099.stdout:(7/130): ceph-common-18.0.0-7418.gb0f45a51.el9. 4.9 MB/s | 19 MB 00:03 2023-11-19T00:36:51.914 INFO:teuthology.orchestra.run.smithi046.stdout:(7/130): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 2.2 MB/s | 4.4 MB 00:02 2023-11-19T00:36:52.154 INFO:teuthology.orchestra.run.smithi181.stdout:(4/130): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 1.8 MB/s | 5.2 MB 00:02 2023-11-19T00:36:52.421 INFO:teuthology.orchestra.run.smithi181.stdout:(5/130): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 1.3 MB/s | 2.1 MB 00:01 2023-11-19T00:36:52.504 INFO:teuthology.orchestra.run.smithi181.stdout:(6/130): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 4.2 MB/s | 1.5 MB 00:00 2023-11-19T00:36:52.851 INFO:teuthology.orchestra.run.smithi099.stdout:(8/130): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 1.0 MB/s | 5.2 MB 00:05 2023-11-19T00:36:52.926 INFO:teuthology.orchestra.run.smithi099.stdout:(9/130): ceph-selinux-18.0.0-7418.gb0f45a51.el9 322 kB/s | 24 kB 00:00 2023-11-19T00:36:53.897 INFO:teuthology.orchestra.run.smithi073.stdout:(10/130): ceph-test-18.0.0-7418.gb0f45a51.el9.x 7.9 MB/s | 41 MB 00:05 2023-11-19T00:36:53.989 INFO:teuthology.orchestra.run.smithi073.stdout:(11/130): libcephfs-devel-18.0.0-7418.gb0f45a51 341 kB/s | 31 kB 00:00 2023-11-19T00:36:54.089 INFO:teuthology.orchestra.run.smithi073.stdout:(12/130): ceph-radosgw-18.0.0-7418.gb0f45a51.el 1.3 MB/s | 8.6 MB 00:06 2023-11-19T00:36:54.243 INFO:teuthology.orchestra.run.smithi099.stdout:(10/130): ceph-radosgw-18.0.0-7418.gb0f45a51.el 3.4 MB/s | 8.6 MB 00:02 2023-11-19T00:36:54.334 INFO:teuthology.orchestra.run.smithi099.stdout:(11/130): libcephfs-devel-18.0.0-7418.gb0f45a51 340 kB/s | 31 kB 00:00 2023-11-19T00:36:54.364 INFO:teuthology.orchestra.run.smithi073.stdout:(13/130): libcephfs2-18.0.0-7418.gb0f45a51.el9. 1.9 MB/s | 718 kB 00:00 2023-11-19T00:36:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:(14/130): librados-devel-18.0.0-7418.gb0f45a51. 2.1 MB/s | 127 kB 00:00 2023-11-19T00:36:54.513 INFO:teuthology.orchestra.run.smithi181.stdout:(7/130): ceph-osd-18.0.0-7418.gb0f45a51.el9.x86 8.8 MB/s | 18 MB 00:02 2023-11-19T00:36:54.515 INFO:teuthology.orchestra.run.smithi073.stdout:(15/130): libradosstriper1-18.0.0-7418.gb0f45a5 5.1 MB/s | 475 kB 00:00 2023-11-19T00:36:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:(12/130): libcephfs2-18.0.0-7418.gb0f45a51.el9. 3.8 MB/s | 718 kB 00:00 2023-11-19T00:36:54.635 INFO:teuthology.orchestra.run.smithi099.stdout:(13/130): libcephsqlite-18.0.0-7418.gb0f45a51.e 1.4 MB/s | 163 kB 00:00 2023-11-19T00:36:54.752 INFO:teuthology.orchestra.run.smithi099.stdout:(14/130): librados-devel-18.0.0-7418.gb0f45a51. 1.1 MB/s | 127 kB 00:00 2023-11-19T00:36:54.994 INFO:teuthology.orchestra.run.smithi099.stdout:(15/130): libradosstriper1-18.0.0-7418.gb0f45a5 1.9 MB/s | 475 kB 00:00 2023-11-19T00:36:55.040 INFO:teuthology.orchestra.run.smithi073.stdout:(16/130): libcephsqlite-18.0.0-7418.gb0f45a51.e 172 kB/s | 163 kB 00:00 2023-11-19T00:36:55.157 INFO:teuthology.orchestra.run.smithi073.stdout:(17/130): python3-ceph-argparse-18.0.0-7418.gb0 388 kB/s | 45 kB 00:00 2023-11-19T00:36:55.366 INFO:teuthology.orchestra.run.smithi073.stdout:(18/130): python3-ceph-common-18.0.0-7418.gb0f4 619 kB/s | 129 kB 00:00 2023-11-19T00:36:55.371 INFO:teuthology.orchestra.run.smithi181.stdout:(8/130): ceph-radosgw-18.0.0-7418.gb0f45a51.el9 10 MB/s | 8.6 MB 00:00 2023-11-19T00:36:55.406 INFO:teuthology.orchestra.run.smithi046.stdout:(8/130): ceph-radosgw-18.0.0-7418.gb0f45a51.el9 2.5 MB/s | 8.6 MB 00:03 2023-11-19T00:36:55.421 INFO:teuthology.orchestra.run.smithi181.stdout:(9/130): ceph-selinux-18.0.0-7418.gb0f45a51.el9 484 kB/s | 24 kB 00:00 2023-11-19T00:36:55.481 INFO:teuthology.orchestra.run.smithi046.stdout:(9/130): ceph-selinux-18.0.0-7418.gb0f45a51.el9 322 kB/s | 24 kB 00:00 2023-11-19T00:36:55.491 INFO:teuthology.orchestra.run.smithi073.stdout:(19/130): librgw2-18.0.0-7418.gb0f45a51.el9.x86 4.9 MB/s | 4.8 MB 00:00 2023-11-19T00:36:55.516 INFO:teuthology.orchestra.run.smithi073.stdout:(20/130): python3-cephfs-18.0.0-7418.gb0f45a51. 1.1 MB/s | 162 kB 00:00 2023-11-19T00:36:55.575 INFO:teuthology.orchestra.run.smithi073.stdout:(21/130): python3-rados-18.0.0-7418.gb0f45a51.e 3.8 MB/s | 321 kB 00:00 2023-11-19T00:36:55.650 INFO:teuthology.orchestra.run.smithi073.stdout:(22/130): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.3 MB/s | 99 kB 00:00 2023-11-19T00:36:55.726 INFO:teuthology.orchestra.run.smithi073.stdout:(23/130): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.1 MB/s | 85 kB 00:00 2023-11-19T00:36:55.776 INFO:teuthology.orchestra.run.smithi073.stdout:(24/130): python3-rbd-18.0.0-7418.gb0f45a51.el9 1.1 MB/s | 299 kB 00:00 2023-11-19T00:36:55.985 INFO:teuthology.orchestra.run.smithi073.stdout:(25/130): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 814 kB/s | 170 kB 00:00 2023-11-19T00:36:56.093 INFO:teuthology.orchestra.run.smithi073.stdout:(26/130): ceph-grafana-dashboards-18.0.0-7418.g 216 kB/s | 23 kB 00:00 2023-11-19T00:36:56.147 INFO:teuthology.orchestra.run.smithi181.stdout:(10/130): ceph-mon-18.0.0-7418.gb0f45a51.el9.x8 1.2 MB/s | 4.4 MB 00:03 2023-11-19T00:36:56.255 INFO:teuthology.orchestra.run.smithi181.stdout:(11/130): libcephfs-devel-18.0.0-7418.gb0f45a51 288 kB/s | 31 kB 00:00 2023-11-19T00:36:56.277 INFO:teuthology.orchestra.run.smithi073.stdout:(27/130): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 724 kB/s | 133 kB 00:00 2023-11-19T00:36:56.352 INFO:teuthology.orchestra.run.smithi073.stdout:(28/130): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 4.8 MB/s | 3.0 MB 00:00 2023-11-19T00:36:56.427 INFO:teuthology.orchestra.run.smithi099.stdout:(16/130): librgw2-18.0.0-7418.gb0f45a51.el9.x86 3.3 MB/s | 4.8 MB 00:01 2023-11-19T00:36:56.544 INFO:teuthology.orchestra.run.smithi099.stdout:(17/130): python3-ceph-argparse-18.0.0-7418.gb0 388 kB/s | 45 kB 00:00 2023-11-19T00:36:56.661 INFO:teuthology.orchestra.run.smithi099.stdout:(18/130): python3-ceph-common-18.0.0-7418.gb0f4 1.1 MB/s | 129 kB 00:00 2023-11-19T00:36:56.778 INFO:teuthology.orchestra.run.smithi099.stdout:(19/130): python3-cephfs-18.0.0-7418.gb0f45a51. 1.4 MB/s | 162 kB 00:00 2023-11-19T00:36:56.964 INFO:teuthology.orchestra.run.smithi181.stdout:(12/130): libcephfs2-18.0.0-7418.gb0f45a51.el9. 1.0 MB/s | 718 kB 00:00 2023-11-19T00:36:56.970 INFO:teuthology.orchestra.run.smithi099.stdout:(20/130): python3-rados-18.0.0-7418.gb0f45a51.e 1.6 MB/s | 321 kB 00:00 2023-11-19T00:36:57.170 INFO:teuthology.orchestra.run.smithi099.stdout:(21/130): python3-rbd-18.0.0-7418.gb0f45a51.el9 1.5 MB/s | 299 kB 00:00 2023-11-19T00:36:57.172 INFO:teuthology.orchestra.run.smithi181.stdout:(13/130): libcephsqlite-18.0.0-7418.gb0f45a51.e 785 kB/s | 163 kB 00:00 2023-11-19T00:36:57.262 INFO:teuthology.orchestra.run.smithi099.stdout:(22/130): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.1 MB/s | 99 kB 00:00 2023-11-19T00:36:57.373 INFO:teuthology.orchestra.run.smithi181.stdout:(14/130): librados-devel-18.0.0-7418.gb0f45a51. 633 kB/s | 127 kB 00:00 2023-11-19T00:36:57.379 INFO:teuthology.orchestra.run.smithi099.stdout:(23/130): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 733 kB/s | 85 kB 00:00 2023-11-19T00:36:57.653 INFO:teuthology.orchestra.run.smithi073.stdout:(29/130): ceph-mgr-dashboard-18.0.0-7418.gb0f45 1.3 MB/s | 1.8 MB 00:01 2023-11-19T00:36:57.831 INFO:teuthology.orchestra.run.smithi181.stdout:(15/130): libradosstriper1-18.0.0-7418.gb0f45a5 1.0 MB/s | 475 kB 00:00 2023-11-19T00:36:57.854 INFO:teuthology.orchestra.run.smithi099.stdout:(24/130): ceph-osd-18.0.0-7418.gb0f45a51.el9.x8 2.6 MB/s | 18 MB 00:06 2023-11-19T00:36:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:(30/130): ceph-mgr-diskprediction-local-18.0.0- 4.8 MB/s | 7.4 MB 00:01 2023-11-19T00:36:57.936 INFO:teuthology.orchestra.run.smithi073.stdout:(31/130): ceph-mgr-modules-core-18.0.0-7418.gb0 856 kB/s | 243 kB 00:00 2023-11-19T00:36:57.971 INFO:teuthology.orchestra.run.smithi099.stdout:(25/130): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 1.4 MB/s | 170 kB 00:00 2023-11-19T00:36:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:(32/130): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 668 kB/s | 50 kB 00:00 2023-11-19T00:36:58.037 INFO:teuthology.orchestra.run.smithi073.stdout:(33/130): ceph-prometheus-alerts-18.0.0-7418.gb 151 kB/s | 15 kB 00:00 2023-11-19T00:36:58.038 INFO:teuthology.orchestra.run.smithi099.stdout:(26/130): ceph-grafana-dashboards-18.0.0-7418.g 351 kB/s | 23 kB 00:00 2023-11-19T00:36:58.070 INFO:teuthology.orchestra.run.smithi073.stdout:(34/130): ceph-volume-18.0.0-7418.gb0f45a51.el9 3.1 MB/s | 262 kB 00:00 2023-11-19T00:36:58.180 INFO:teuthology.orchestra.run.smithi099.stdout:(27/130): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 937 kB/s | 133 kB 00:00 2023-11-19T00:36:58.196 INFO:teuthology.orchestra.run.smithi073.stdout:(35/130): automake-1.16.2-8.el9.noarch.rpm 5.2 MB/s | 662 kB 00:00 2023-11-19T00:36:58.254 INFO:teuthology.orchestra.run.smithi073.stdout:(36/130): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2023-11-19T00:36:58.288 INFO:teuthology.orchestra.run.smithi073.stdout:(37/130): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-19T00:36:58.322 INFO:teuthology.orchestra.run.smithi073.stdout:(38/130): elfutils-libelf-devel-0.190-1.el9.x86 648 kB/s | 21 kB 00:00 2023-11-19T00:36:58.355 INFO:teuthology.orchestra.run.smithi073.stdout:(39/130): flex-2.6.4-9.el9.x86_64.rpm 9.1 MB/s | 307 kB 00:00 2023-11-19T00:36:58.381 INFO:teuthology.orchestra.run.smithi099.stdout:(28/130): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 3.0 MB/s | 3.0 MB 00:01 2023-11-19T00:36:58.397 INFO:teuthology.orchestra.run.smithi073.stdout:(40/130): flexiblas-3.0.4-8.el9.x86_64.rpm 760 kB/s | 32 kB 00:00 2023-11-19T00:36:58.472 INFO:teuthology.orchestra.run.smithi073.stdout:(41/130): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2023-11-19T00:36:58.506 INFO:teuthology.orchestra.run.smithi073.stdout:(42/130): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2023-11-19T00:36:58.539 INFO:teuthology.orchestra.run.smithi073.stdout:(43/130): jq-1.6-16.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-11-19T00:36:58.565 INFO:teuthology.orchestra.run.smithi073.stdout:(44/130): cephadm-18.0.0-7418.gb0f45a51.el9.noa 1.4 MB/s | 774 kB 00:00 2023-11-19T00:36:58.582 INFO:teuthology.orchestra.run.smithi073.stdout:(45/130): libaio-devel-0.3.111-13.el9.x86_64.rp 240 kB/s | 10 kB 00:00 2023-11-19T00:36:58.607 INFO:teuthology.orchestra.run.smithi073.stdout:(46/130): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-11-19T00:36:58.624 INFO:teuthology.orchestra.run.smithi073.stdout:(47/130): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-11-19T00:36:58.649 INFO:teuthology.orchestra.run.smithi073.stdout:(48/130): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2023-11-19T00:36:58.675 INFO:teuthology.orchestra.run.smithi073.stdout:(49/130): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2023-11-19T00:36:58.691 INFO:teuthology.orchestra.run.smithi073.stdout:(50/130): libuuid-devel-2.37.4-15.el9.x86_64.rp 597 kB/s | 24 kB 00:00 2023-11-19T00:36:58.708 INFO:teuthology.orchestra.run.smithi073.stdout:(51/130): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-19T00:36:58.734 INFO:teuthology.orchestra.run.smithi073.stdout:(52/130): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-11-19T00:36:58.759 INFO:teuthology.orchestra.run.smithi073.stdout:(53/130): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-11-19T00:36:58.776 INFO:teuthology.orchestra.run.smithi073.stdout:(54/130): openblas-0.3.21-2.el9.x86_64.rpm 817 kB/s | 34 kB 00:00 2023-11-19T00:36:58.852 INFO:teuthology.orchestra.run.smithi073.stdout:(55/130): openblas-openmp-0.3.21-2.el9.x86_64.r 52 MB/s | 4.7 MB 00:00 2023-11-19T00:36:58.919 INFO:teuthology.orchestra.run.smithi073.stdout:(56/130): openssl-devel-3.0.7-24.el9.x86_64.rpm 21 MB/s | 3.0 MB 00:00 2023-11-19T00:36:59.002 INFO:teuthology.orchestra.run.smithi073.stdout:(57/130): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2023-11-19T00:36:59.027 INFO:teuthology.orchestra.run.smithi073.stdout:(58/130): python3-jinja2-2.11.3-4.el9.noarch.rp 2.1 MB/s | 228 kB 00:00 2023-11-19T00:36:59.061 INFO:teuthology.orchestra.run.smithi073.stdout:(59/130): python3-jsonpointer-2.0-4.el9.noarch. 552 kB/s | 18 kB 00:00 2023-11-19T00:36:59.072 INFO:teuthology.orchestra.run.smithi099.stdout:(29/130): ceph-mgr-dashboard-18.0.0-7418.gb0f45 2.0 MB/s | 1.8 MB 00:00 2023-11-19T00:36:59.086 INFO:teuthology.orchestra.run.smithi073.stdout:(60/130): python3-jsonpatch-1.21-16.el9.noarch. 419 kB/s | 24 kB 00:00 2023-11-19T00:36:59.111 INFO:teuthology.orchestra.run.smithi073.stdout:(61/130): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-11-19T00:36:59.137 INFO:teuthology.orchestra.run.smithi073.stdout:(62/130): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2023-11-19T00:36:59.220 INFO:teuthology.orchestra.run.smithi073.stdout:(63/130): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 4.8 MB 00:00 2023-11-19T00:36:59.223 INFO:teuthology.orchestra.run.smithi099.stdout:(30/130): ceph-mgr-modules-core-18.0.0-7418.gb0 1.6 MB/s | 243 kB 00:00 2023-11-19T00:36:59.245 INFO:teuthology.orchestra.run.smithi073.stdout:(64/130): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 217 kB 00:00 2023-11-19T00:36:59.271 INFO:teuthology.orchestra.run.smithi073.stdout:(65/130): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-11-19T00:36:59.290 INFO:teuthology.orchestra.run.smithi099.stdout:(31/130): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 754 kB/s | 50 kB 00:00 2023-11-19T00:36:59.296 INFO:teuthology.orchestra.run.smithi073.stdout:(66/130): python3-prettytable-0.7.2-27.el9.noar 825 kB/s | 41 kB 00:00 2023-11-19T00:36:59.321 INFO:teuthology.orchestra.run.smithi073.stdout:(67/130): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-19T00:36:59.331 INFO:teuthology.orchestra.run.smithi099.stdout:(32/130): ceph-prometheus-alerts-18.0.0-7418.gb 365 kB/s | 15 kB 00:00 2023-11-19T00:36:59.346 INFO:teuthology.orchestra.run.smithi073.stdout:(68/130): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-11-19T00:36:59.364 INFO:teuthology.orchestra.run.smithi073.stdout:(69/130): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2023-11-19T00:36:59.375 INFO:teuthology.orchestra.run.smithi073.stdout:(70/130): python3-requests-oauthlib-1.3.0-12.el 1.5 MB/s | 43 kB 00:00 2023-11-19T00:36:59.424 INFO:teuthology.orchestra.run.smithi099.stdout:(33/130): ceph-volume-18.0.0-7418.gb0f45a51.el9 2.8 MB/s | 262 kB 00:00 2023-11-19T00:36:59.425 INFO:teuthology.orchestra.run.smithi073.stdout:(71/130): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 39 kB 00:00 2023-11-19T00:36:59.618 INFO:teuthology.orchestra.run.smithi073.stdout:(72/130): python3-scipy-1.6.2-8.el9.x86_64.rpm 62 MB/s | 16 MB 00:00 2023-11-19T00:36:59.641 INFO:teuthology.orchestra.run.smithi099.stdout:(34/130): cephadm-18.0.0-7418.gb0f45a51.el9.noa 3.5 MB/s | 774 kB 00:00 2023-11-19T00:36:59.643 INFO:teuthology.orchestra.run.smithi073.stdout:(73/130): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2023-11-19T00:36:59.677 INFO:teuthology.orchestra.run.smithi073.stdout:(74/130): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-19T00:36:59.698 INFO:teuthology.orchestra.run.smithi181.stdout:(16/130): ceph-test-18.0.0-7418.gb0f45a51.el9.x 9.6 MB/s | 41 MB 00:04 2023-11-19T00:36:59.702 INFO:teuthology.orchestra.run.smithi073.stdout:(75/130): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.0 MB/s | 85 kB 00:00 2023-11-19T00:36:59.719 INFO:teuthology.orchestra.run.smithi073.stdout:(76/130): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-11-19T00:36:59.736 INFO:teuthology.orchestra.run.smithi073.stdout:(77/130): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-11-19T00:36:59.749 INFO:teuthology.orchestra.run.smithi181.stdout:(17/130): python3-ceph-argparse-18.0.0-7418.gb0 908 kB/s | 45 kB 00:00 2023-11-19T00:36:59.766 INFO:teuthology.orchestra.run.smithi099.stdout:(35/130): automake-1.16.2-8.el9.noarch.rpm 5.2 MB/s | 662 kB 00:00 2023-11-19T00:36:59.816 INFO:teuthology.orchestra.run.smithi099.stdout:(36/130): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2023-11-19T00:36:59.850 INFO:teuthology.orchestra.run.smithi099.stdout:(37/130): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-19T00:36:59.882 INFO:teuthology.orchestra.run.smithi181.stdout:(18/130): python3-ceph-common-18.0.0-7418.gb0f4 973 kB/s | 129 kB 00:00 2023-11-19T00:36:59.912 INFO:teuthology.orchestra.run.smithi073.stdout:(78/130): libgfortran-11.4.1-2.3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2023-11-19T00:36:59.937 INFO:teuthology.orchestra.run.smithi073.stdout:(79/130): libquadmath-11.4.1-2.3.el9.x86_64.rpm 980 kB/s | 195 kB 00:00 2023-11-19T00:36:59.949 INFO:teuthology.orchestra.run.smithi181.stdout:(19/130): python3-cephfs-18.0.0-7418.gb0f45a51. 2.3 MB/s | 162 kB 00:00 2023-11-19T00:36:59.954 INFO:teuthology.orchestra.run.smithi073.stdout:(80/130): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2023-11-19T00:36:59.967 INFO:teuthology.orchestra.run.smithi099.stdout:(38/130): elfutils-libelf-devel-0.190-1.el9.x86 185 kB/s | 21 kB 00:00 2023-11-19T00:36:59.973 INFO:teuthology.orchestra.run.smithi046.stdout:(10/130): ceph-common-18.0.0-7418.gb0f45a51.el9 1.5 MB/s | 19 MB 00:12 2023-11-19T00:36:59.988 INFO:teuthology.orchestra.run.smithi073.stdout:(81/130): python3-cryptography-36.0.1-4.el9.x86 23 MB/s | 1.1 MB 00:00 2023-11-19T00:36:59.999 INFO:teuthology.orchestra.run.smithi181.stdout:(20/130): python3-rados-18.0.0-7418.gb0f45a51.e 6.3 MB/s | 321 kB 00:00 2023-11-19T00:37:00.013 INFO:teuthology.orchestra.run.smithi073.stdout:(82/130): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-11-19T00:37:00.031 INFO:teuthology.orchestra.run.smithi046.stdout:(11/130): libcephfs-devel-18.0.0-7418.gb0f45a51 536 kB/s | 31 kB 00:00 2023-11-19T00:37:00.038 INFO:teuthology.orchestra.run.smithi073.stdout:(83/130): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-11-19T00:37:00.050 INFO:teuthology.orchestra.run.smithi181.stdout:(21/130): python3-rbd-18.0.0-7418.gb0f45a51.el9 5.9 MB/s | 299 kB 00:00 2023-11-19T00:37:00.059 INFO:teuthology.orchestra.run.smithi099.stdout:(39/130): ceph-mgr-diskprediction-local-18.0.0- 4.4 MB/s | 7.4 MB 00:01 2023-11-19T00:37:00.064 INFO:teuthology.orchestra.run.smithi073.stdout:(84/130): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-11-19T00:37:00.089 INFO:teuthology.orchestra.run.smithi073.stdout:(85/130): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-19T00:37:00.093 INFO:teuthology.orchestra.run.smithi099.stdout:(40/130): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 307 kB 00:00 2023-11-19T00:37:00.100 INFO:teuthology.orchestra.run.smithi181.stdout:(22/130): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.9 MB/s | 99 kB 00:00 2023-11-19T00:37:00.109 INFO:teuthology.orchestra.run.smithi099.stdout:(41/130): flexiblas-3.0.4-8.el9.x86_64.rpm 638 kB/s | 32 kB 00:00 2023-11-19T00:37:00.150 INFO:teuthology.orchestra.run.smithi181.stdout:(23/130): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.7 MB/s | 85 kB 00:00 2023-11-19T00:37:00.176 INFO:teuthology.orchestra.run.smithi099.stdout:(42/130): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2023-11-19T00:37:00.193 INFO:teuthology.orchestra.run.smithi099.stdout:(43/130): flexiblas-openblas-openmp-3.0.4-8.el9 212 kB/s | 17 kB 00:00 2023-11-19T00:37:00.219 INFO:teuthology.orchestra.run.smithi099.stdout:(44/130): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-11-19T00:37:00.236 INFO:teuthology.orchestra.run.smithi099.stdout:(45/130): libaio-devel-0.3.111-13.el9.x86_64.rp 243 kB/s | 10 kB 00:00 2023-11-19T00:37:00.253 INFO:teuthology.orchestra.run.smithi099.stdout:(46/130): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.6 MB/s | 159 kB 00:00 2023-11-19T00:37:00.270 INFO:teuthology.orchestra.run.smithi099.stdout:(47/130): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-19T00:37:00.281 INFO:teuthology.orchestra.run.smithi073.stdout:(86/130): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.6 MB/s | 309 kB 00:00 2023-11-19T00:37:00.295 INFO:teuthology.orchestra.run.smithi099.stdout:(48/130): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2023-11-19T00:37:00.329 INFO:teuthology.orchestra.run.smithi099.stdout:(49/130): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-11-19T00:37:00.332 INFO:teuthology.orchestra.run.smithi046.stdout:(12/130): libcephfs2-18.0.0-7418.gb0f45a51.el9. 2.3 MB/s | 718 kB 00:00 2023-11-19T00:37:00.346 INFO:teuthology.orchestra.run.smithi099.stdout:(50/130): libuuid-devel-2.37.4-15.el9.x86_64.rp 496 kB/s | 24 kB 00:00 2023-11-19T00:37:00.363 INFO:teuthology.orchestra.run.smithi099.stdout:(51/130): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-19T00:37:00.388 INFO:teuthology.orchestra.run.smithi099.stdout:(52/130): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-11-19T00:37:00.413 INFO:teuthology.orchestra.run.smithi099.stdout:(53/130): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-11-19T00:37:00.417 INFO:teuthology.orchestra.run.smithi181.stdout:(24/130): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 11 MB/s | 3.0 MB 00:00 2023-11-19T00:37:00.438 INFO:teuthology.orchestra.run.smithi099.stdout:(54/130): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2023-11-19T00:37:00.457 INFO:teuthology.orchestra.run.smithi046.stdout:(13/130): libcephsqlite-18.0.0-7418.gb0f45a51.e 1.3 MB/s | 163 kB 00:00 2023-11-19T00:37:00.467 INFO:teuthology.orchestra.run.smithi181.stdout:(25/130): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 3.3 MB/s | 170 kB 00:00 2023-11-19T00:37:00.514 INFO:teuthology.orchestra.run.smithi099.stdout:(55/130): openblas-openmp-0.3.21-2.el9.x86_64.r 47 MB/s | 4.7 MB 00:00 2023-11-19T00:37:00.518 INFO:teuthology.orchestra.run.smithi181.stdout:(26/130): ceph-grafana-dashboards-18.0.0-7418.g 468 kB/s | 23 kB 00:00 2023-11-19T00:37:00.523 INFO:teuthology.orchestra.run.smithi046.stdout:(14/130): librados-devel-18.0.0-7418.gb0f45a51. 1.9 MB/s | 127 kB 00:00 2023-11-19T00:37:00.564 INFO:teuthology.orchestra.run.smithi099.stdout:(56/130): openssl-devel-3.0.7-24.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2023-11-19T00:37:00.568 INFO:teuthology.orchestra.run.smithi181.stdout:(27/130): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 2.6 MB/s | 133 kB 00:00 2023-11-19T00:37:00.635 INFO:teuthology.orchestra.run.smithi181.stdout:(28/130): librgw2-18.0.0-7418.gb0f45a51.el9.x86 1.7 MB/s | 4.8 MB 00:02 2023-11-19T00:37:00.640 INFO:teuthology.orchestra.run.smithi073.stdout:(87/130): ceph-common-18.0.0-7418.gb0f45a51.el9 1.3 MB/s | 19 MB 00:14 2023-11-19T00:37:00.651 INFO:teuthology.orchestra.run.smithi099.stdout:(57/130): python3-babel-2.9.1-2.el9.noarch.rpm 43 MB/s | 5.8 MB 00:00 2023-11-19T00:37:00.677 INFO:teuthology.orchestra.run.smithi099.stdout:(58/130): python3-jinja2-2.11.3-4.el9.noarch.rp 2.0 MB/s | 228 kB 00:00 2023-11-19T00:37:00.710 INFO:teuthology.orchestra.run.smithi099.stdout:(59/130): python3-jsonpatch-1.21-16.el9.noarch. 742 kB/s | 24 kB 00:00 2023-11-19T00:37:00.724 INFO:teuthology.orchestra.run.smithi046.stdout:(15/130): libradosstriper1-18.0.0-7418.gb0f45a5 2.3 MB/s | 475 kB 00:00 2023-11-19T00:37:00.731 INFO:teuthology.orchestra.run.smithi073.stdout:(88/130): libarrow-doc-9.0.0-9.el9.noarch.rpm 267 kB/s | 24 kB 00:00 2023-11-19T00:37:00.735 INFO:teuthology.orchestra.run.smithi099.stdout:(60/130): python3-jsonpointer-2.0-4.el9.noarch. 311 kB/s | 18 kB 00:00 2023-11-19T00:37:00.744 INFO:teuthology.orchestra.run.smithi181.stdout:(29/130): ceph-mgr-dashboard-18.0.0-7418.gb0f45 10 MB/s | 1.8 MB 00:00 2023-11-19T00:37:00.757 INFO:teuthology.orchestra.run.smithi073.stdout:(89/130): python3-devel-3.9.17-2.el9.x86_64.rpm 354 kB/s | 245 kB 00:00 2023-11-19T00:37:00.769 INFO:teuthology.orchestra.run.smithi099.stdout:(61/130): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-11-19T00:37:00.794 INFO:teuthology.orchestra.run.smithi181.stdout:(30/130): ceph-mgr-modules-core-18.0.0-7418.gb0 4.7 MB/s | 243 kB 00:00 2023-11-19T00:37:00.795 INFO:teuthology.orchestra.run.smithi099.stdout:(62/130): python3-markupsafe-1.1.1-12.el9.x86_6 537 kB/s | 32 kB 00:00 2023-11-19T00:37:00.798 INFO:teuthology.orchestra.run.smithi073.stdout:(90/130): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2023-11-19T00:37:00.853 INFO:teuthology.orchestra.run.smithi181.stdout:(31/130): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 862 kB/s | 50 kB 00:00 2023-11-19T00:37:00.870 INFO:teuthology.orchestra.run.smithi099.stdout:(63/130): python3-numpy-1.20.1-5.el9.x86_64.rpm 48 MB/s | 4.8 MB 00:00 2023-11-19T00:37:00.895 INFO:teuthology.orchestra.run.smithi099.stdout:(64/130): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 217 kB 00:00 2023-11-19T00:37:00.903 INFO:teuthology.orchestra.run.smithi181.stdout:(32/130): ceph-prometheus-alerts-18.0.0-7418.gb 302 kB/s | 15 kB 00:00 2023-11-19T00:37:00.921 INFO:teuthology.orchestra.run.smithi099.stdout:(65/130): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-11-19T00:37:00.924 INFO:teuthology.orchestra.run.smithi073.stdout:(91/130): libarrow-9.0.0-9.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2023-11-19T00:37:00.946 INFO:teuthology.orchestra.run.smithi099.stdout:(66/130): python3-prettytable-0.7.2-27.el9.noar 828 kB/s | 41 kB 00:00 2023-11-19T00:37:00.949 INFO:teuthology.orchestra.run.smithi073.stdout:(92/130): libunwind-1.6.2-1.el9.x86_64.rpm 351 kB/s | 67 kB 00:00 2023-11-19T00:37:00.953 INFO:teuthology.orchestra.run.smithi181.stdout:(33/130): ceph-volume-18.0.0-7418.gb0f45a51.el9 5.1 MB/s | 262 kB 00:00 2023-11-19T00:37:00.971 INFO:teuthology.orchestra.run.smithi099.stdout:(67/130): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-19T00:37:00.996 INFO:teuthology.orchestra.run.smithi099.stdout:(68/130): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-11-19T00:37:00.999 INFO:teuthology.orchestra.run.smithi073.stdout:(93/130): python3-asyncssh-2.13.2-3.el9.noarch. 7.1 MB/s | 548 kB 00:00 2023-11-19T00:37:01.016 INFO:teuthology.orchestra.run.smithi073.stdout:(94/130): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 650 kB/s | 43 kB 00:00 2023-11-19T00:37:01.021 INFO:teuthology.orchestra.run.smithi099.stdout:(69/130): python3-pytz-2021.1-5.el9.noarch.rpm 947 kB/s | 47 kB 00:00 2023-11-19T00:37:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:(95/130): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.4 MB/s | 837 kB 00:00 2023-11-19T00:37:01.045 INFO:teuthology.orchestra.run.smithi181.stdout:(34/130): cephadm-18.0.0-7418.gb0f45a51.el9.noa 8.3 MB/s | 774 kB 00:00 2023-11-19T00:37:01.047 INFO:teuthology.orchestra.run.smithi099.stdout:(70/130): python3-requests-oauthlib-1.3.0-12.el 852 kB/s | 43 kB 00:00 2023-11-19T00:37:01.059 INFO:teuthology.orchestra.run.smithi073.stdout:(96/130): python3-certifi-2021.10.8-2.el9.noarc 358 kB/s | 15 kB 00:00 2023-11-19T00:37:01.076 INFO:teuthology.orchestra.run.smithi073.stdout:(97/130): python3-cachetools-4.2.4-1.el9.noarch 425 kB/s | 32 kB 00:00 2023-11-19T00:37:01.106 INFO:teuthology.orchestra.run.smithi099.stdout:(71/130): python3-toml-0.10.2-6.el9.noarch.rpm 694 kB/s | 39 kB 00:00 2023-11-19T00:37:01.120 INFO:teuthology.orchestra.run.smithi073.stdout:(98/130): python3-cheroot-8.6.0-4.el9.noarch.rp 2.2 MB/s | 172 kB 00:00 2023-11-19T00:37:01.151 INFO:teuthology.orchestra.run.smithi073.stdout:(99/130): python3-google-auth-2.23.4-1.el9.noar 2.6 MB/s | 197 kB 00:00 2023-11-19T00:37:01.168 INFO:teuthology.orchestra.run.smithi073.stdout:(100/130): python3-jaraco-8.2.1-3.el9.noarch.rp 222 kB/s | 11 kB 00:00 2023-11-19T00:37:01.171 INFO:teuthology.orchestra.run.smithi181.stdout:(35/130): automake-1.16.2-8.el9.noarch.rpm 5.2 MB/s | 662 kB 00:00 2023-11-19T00:37:01.194 INFO:teuthology.orchestra.run.smithi073.stdout:(101/130): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-11-19T00:37:01.210 INFO:teuthology.orchestra.run.smithi073.stdout:(102/130): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2023-11-19T00:37:01.227 INFO:teuthology.orchestra.run.smithi073.stdout:(103/130): python3-jaraco-collections-3.0.0-8.e 394 kB/s | 23 kB 00:00 2023-11-19T00:37:01.229 INFO:teuthology.orchestra.run.smithi181.stdout:(36/130): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2023-11-19T00:37:01.244 INFO:teuthology.orchestra.run.smithi073.stdout:(104/130): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2023-11-19T00:37:01.261 INFO:teuthology.orchestra.run.smithi073.stdout:(105/130): python3-jwt+crypto-2.4.0-1.el9.noarc 271 kB/s | 9.0 kB 00:00 2023-11-19T00:37:01.263 INFO:teuthology.orchestra.run.smithi181.stdout:(37/130): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-19T00:37:01.278 INFO:teuthology.orchestra.run.smithi073.stdout:(106/130): python3-jaraco-text-3.2.0-6.el9.noar 389 kB/s | 20 kB 00:00 2023-11-19T00:37:01.295 INFO:teuthology.orchestra.run.smithi073.stdout:(107/130): python3-jwt-2.4.0-1.el9.noarch.rpm 806 kB/s | 41 kB 00:00 2023-11-19T00:37:01.296 INFO:teuthology.orchestra.run.smithi181.stdout:(38/130): elfutils-libelf-devel-0.190-1.el9.x86 648 kB/s | 21 kB 00:00 2023-11-19T00:37:01.297 INFO:teuthology.orchestra.run.smithi099.stdout:(72/130): python3-scipy-1.6.2-8.el9.x86_64.rpm 57 MB/s | 16 MB 00:00 2023-11-19T00:37:01.320 INFO:teuthology.orchestra.run.smithi073.stdout:(108/130): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2023-11-19T00:37:01.322 INFO:teuthology.orchestra.run.smithi099.stdout:(73/130): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2023-11-19T00:37:01.338 INFO:teuthology.orchestra.run.smithi181.stdout:(39/130): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-11-19T00:37:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:(109/130): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-11-19T00:37:01.348 INFO:teuthology.orchestra.run.smithi099.stdout:(74/130): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-11-19T00:37:01.371 INFO:teuthology.orchestra.run.smithi073.stdout:(110/130): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-11-19T00:37:01.372 INFO:teuthology.orchestra.run.smithi181.stdout:(40/130): flexiblas-3.0.4-8.el9.x86_64.rpm 953 kB/s | 32 kB 00:00 2023-11-19T00:37:01.373 INFO:teuthology.orchestra.run.smithi099.stdout:(75/130): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-11-19T00:37:01.399 INFO:teuthology.orchestra.run.smithi099.stdout:(76/130): zlib-devel-1.2.11-40.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2023-11-19T00:37:01.421 INFO:teuthology.orchestra.run.smithi073.stdout:(111/130): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2023-11-19T00:37:01.424 INFO:teuthology.orchestra.run.smithi099.stdout:(77/130): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-11-19T00:37:01.447 INFO:teuthology.orchestra.run.smithi073.stdout:(112/130): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2023-11-19T00:37:01.447 INFO:teuthology.orchestra.run.smithi181.stdout:(41/130): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2023-11-19T00:37:01.466 INFO:teuthology.orchestra.run.smithi099.stdout:(78/130): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-19T00:37:01.472 INFO:teuthology.orchestra.run.smithi073.stdout:(113/130): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2023-11-19T00:37:01.481 INFO:teuthology.orchestra.run.smithi181.stdout:(42/130): flexiblas-openblas-openmp-3.0.4-8.el9 514 kB/s | 17 kB 00:00 2023-11-19T00:37:01.491 INFO:teuthology.orchestra.run.smithi099.stdout:(79/130): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-11-19T00:37:01.497 INFO:teuthology.orchestra.run.smithi073.stdout:(114/130): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-11-19T00:37:01.515 INFO:teuthology.orchestra.run.smithi181.stdout:(43/130): jq-1.6-16.el9.x86_64.rpm 5.4 MB/s | 186 kB 00:00 2023-11-19T00:37:01.517 INFO:teuthology.orchestra.run.smithi099.stdout:(80/130): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-19T00:37:01.522 INFO:teuthology.orchestra.run.smithi073.stdout:(115/130): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2023-11-19T00:37:01.548 INFO:teuthology.orchestra.run.smithi073.stdout:(116/130): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2023-11-19T00:37:01.548 INFO:teuthology.orchestra.run.smithi181.stdout:(44/130): libaio-devel-0.3.111-13.el9.x86_64.rp 302 kB/s | 10 kB 00:00 2023-11-19T00:37:01.550 INFO:teuthology.orchestra.run.smithi099.stdout:(81/130): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2023-11-19T00:37:01.573 INFO:teuthology.orchestra.run.smithi073.stdout:(117/130): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-11-19T00:37:01.575 INFO:teuthology.orchestra.run.smithi099.stdout:(82/130): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-11-19T00:37:01.582 INFO:teuthology.orchestra.run.smithi181.stdout:(45/130): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-11-19T00:37:01.598 INFO:teuthology.orchestra.run.smithi073.stdout:(118/130): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2023-11-19T00:37:01.600 INFO:teuthology.orchestra.run.smithi099.stdout:(83/130): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-11-19T00:37:01.615 INFO:teuthology.orchestra.run.smithi181.stdout:(46/130): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-19T00:37:01.624 INFO:teuthology.orchestra.run.smithi073.stdout:(119/130): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2023-11-19T00:37:01.626 INFO:teuthology.orchestra.run.smithi099.stdout:(84/130): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-11-19T00:37:01.649 INFO:teuthology.orchestra.run.smithi073.stdout:(120/130): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-11-19T00:37:01.651 INFO:teuthology.orchestra.run.smithi099.stdout:(85/130): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-19T00:37:01.658 INFO:teuthology.orchestra.run.smithi181.stdout:(47/130): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2023-11-19T00:37:01.674 INFO:teuthology.orchestra.run.smithi073.stdout:(121/130): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-11-19T00:37:01.699 INFO:teuthology.orchestra.run.smithi073.stdout:(122/130): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2023-11-19T00:37:01.700 INFO:teuthology.orchestra.run.smithi181.stdout:(48/130): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-11-19T00:37:01.725 INFO:teuthology.orchestra.run.smithi073.stdout:(123/130): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-11-19T00:37:01.733 INFO:teuthology.orchestra.run.smithi181.stdout:(49/130): libuuid-devel-2.37.4-15.el9.x86_64.rp 735 kB/s | 24 kB 00:00 2023-11-19T00:37:01.745 INFO:teuthology.orchestra.run.smithi073.stdout:(124/130): python3-werkzeug-2.0.3-3.el9.1.noarc 3.4 MB/s | 427 kB 00:00 2023-11-19T00:37:01.767 INFO:teuthology.orchestra.run.smithi181.stdout:(50/130): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-19T00:37:01.801 INFO:teuthology.orchestra.run.smithi181.stdout:(51/130): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-11-19T00:37:01.834 INFO:teuthology.orchestra.run.smithi181.stdout:(52/130): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-11-19T00:37:01.868 INFO:teuthology.orchestra.run.smithi181.stdout:(53/130): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-11-19T00:37:01.943 INFO:teuthology.orchestra.run.smithi099.stdout:(86/130): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.0 MB/s | 309 kB 00:00 2023-11-19T00:37:01.952 INFO:teuthology.orchestra.run.smithi181.stdout:(54/130): openblas-openmp-0.3.21-2.el9.x86_64.r 57 MB/s | 4.7 MB 00:00 2023-11-19T00:37:01.991 INFO:teuthology.orchestra.run.smithi046.stdout:(16/130): ceph-osd-18.0.0-7418.gb0f45a51.el9.x8 1.6 MB/s | 18 MB 00:10 2023-11-19T00:37:02.012 INFO:teuthology.orchestra.run.smithi073.stdout:(125/130): thrift-0.15.0-2.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2023-11-19T00:37:02.018 INFO:teuthology.orchestra.run.smithi181.stdout:(55/130): openssl-devel-3.0.7-24.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2023-11-19T00:37:02.037 INFO:teuthology.orchestra.run.smithi073.stdout:(126/130): elfutils-debuginfod-client-0.190-1.e 1.4 MB/s | 36 kB 00:00 2023-11-19T00:37:02.049 INFO:teuthology.orchestra.run.smithi046.stdout:(17/130): python3-ceph-argparse-18.0.0-7418.gb0 778 kB/s | 45 kB 00:00 2023-11-19T00:37:02.071 INFO:teuthology.orchestra.run.smithi073.stdout:(127/130): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-11-19T00:37:02.105 INFO:teuthology.orchestra.run.smithi073.stdout:(128/130): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-11-19T00:37:02.119 INFO:teuthology.orchestra.run.smithi181.stdout:(56/130): python3-babel-2.9.1-2.el9.noarch.rpm 58 MB/s | 5.8 MB 00:00 2023-11-19T00:37:02.133 INFO:teuthology.orchestra.run.smithi046.stdout:(18/130): python3-ceph-common-18.0.0-7418.gb0f4 1.5 MB/s | 129 kB 00:00 2023-11-19T00:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout:(57/130): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-11-19T00:37:02.181 INFO:teuthology.orchestra.run.smithi073.stdout:(129/130): librbd1-18.0.0-7418.gb0f45a51.el9.x8 7.0 MB/s | 3.0 MB 00:00 2023-11-19T00:37:02.186 INFO:teuthology.orchestra.run.smithi181.stdout:(58/130): python3-jsonpatch-1.21-16.el9.noarch. 982 kB/s | 24 kB 00:00 2023-11-19T00:37:02.200 INFO:teuthology.orchestra.run.smithi046.stdout:(19/130): librgw2-18.0.0-7418.gb0f45a51.el9.x86 3.2 MB/s | 4.8 MB 00:01 2023-11-19T00:37:02.219 INFO:teuthology.orchestra.run.smithi181.stdout:(59/130): python3-jsonpointer-2.0-4.el9.noarch. 544 kB/s | 18 kB 00:00 2023-11-19T00:37:02.253 INFO:teuthology.orchestra.run.smithi181.stdout:(60/130): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-11-19T00:37:02.258 INFO:teuthology.orchestra.run.smithi046.stdout:(20/130): python3-cephfs-18.0.0-7418.gb0f45a51. 1.3 MB/s | 162 kB 00:00 2023-11-19T00:37:02.285 INFO:teuthology.orchestra.run.smithi099.stdout:(87/130): libarrow-9.0.0-9.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2023-11-19T00:37:02.287 INFO:teuthology.orchestra.run.smithi181.stdout:(61/130): python3-markupsafe-1.1.1-12.el9.x86_6 946 kB/s | 32 kB 00:00 2023-11-19T00:37:02.310 INFO:teuthology.orchestra.run.smithi099.stdout:(88/130): python3-devel-3.9.17-2.el9.x86_64.rpm 359 kB/s | 245 kB 00:00 2023-11-19T00:37:02.336 INFO:teuthology.orchestra.run.smithi099.stdout:(89/130): libarrow-doc-9.0.0-9.el9.noarch.rpm 483 kB/s | 24 kB 00:00 2023-11-19T00:37:02.342 INFO:teuthology.orchestra.run.smithi046.stdout:(21/130): python3-rados-18.0.0-7418.gb0f45a51.e 2.2 MB/s | 321 kB 00:00 2023-11-19T00:37:02.367 INFO:teuthology.orchestra.run.smithi046.stdout:(22/130): python3-rbd-18.0.0-7418.gb0f45a51.el9 2.7 MB/s | 299 kB 00:00 2023-11-19T00:37:02.379 INFO:teuthology.orchestra.run.smithi181.stdout:(62/130): python3-numpy-1.20.1-5.el9.x86_64.rpm 52 MB/s | 4.8 MB 00:00 2023-11-19T00:37:02.386 INFO:teuthology.orchestra.run.smithi099.stdout:(90/130): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-11-19T00:37:02.401 INFO:teuthology.orchestra.run.smithi046.stdout:(23/130): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.7 MB/s | 99 kB 00:00 2023-11-19T00:37:02.412 INFO:teuthology.orchestra.run.smithi181.stdout:(63/130): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.5 MB/s | 217 kB 00:00 2023-11-19T00:37:02.434 INFO:teuthology.orchestra.run.smithi046.stdout:(24/130): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.2 MB/s | 85 kB 00:00 2023-11-19T00:37:02.446 INFO:teuthology.orchestra.run.smithi181.stdout:(64/130): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2023-11-19T00:37:02.478 INFO:teuthology.orchestra.run.smithi099.stdout:(91/130): parquet-libs-9.0.0-9.el9.x86_64.rpm 8.9 MB/s | 837 kB 00:00 2023-11-19T00:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout:(65/130): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-11-19T00:37:02.513 INFO:teuthology.orchestra.run.smithi181.stdout:(66/130): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-11-19T00:37:02.535 INFO:teuthology.orchestra.run.smithi046.stdout:(25/130): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 1.7 MB/s | 170 kB 00:00 2023-11-19T00:37:02.537 INFO:teuthology.orchestra.run.smithi099.stdout:(92/130): liboath-2.6.7-2.el9.x86_64.rpm 215 kB/s | 49 kB 00:00 2023-11-19T00:37:02.547 INFO:teuthology.orchestra.run.smithi181.stdout:(67/130): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2023-11-19T00:37:02.570 INFO:teuthology.orchestra.run.smithi099.stdout:(93/130): python3-asyncssh-2.13.2-3.el9.noarch. 5.8 MB/s | 548 kB 00:00 2023-11-19T00:37:02.580 INFO:teuthology.orchestra.run.smithi181.stdout:(68/130): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-11-19T00:37:02.596 INFO:teuthology.orchestra.run.smithi099.stdout:(94/130): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 742 kB/s | 43 kB 00:00 2023-11-19T00:37:02.602 INFO:teuthology.orchestra.run.smithi046.stdout:(26/130): ceph-grafana-dashboards-18.0.0-7418.g 352 kB/s | 23 kB 00:00 2023-11-19T00:37:02.614 INFO:teuthology.orchestra.run.smithi181.stdout:(69/130): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-11-19T00:37:02.629 INFO:teuthology.orchestra.run.smithi099.stdout:(95/130): python3-cachetools-4.2.4-1.el9.noarch 549 kB/s | 32 kB 00:00 2023-11-19T00:37:02.655 INFO:teuthology.orchestra.run.smithi099.stdout:(96/130): python3-certifi-2021.10.8-2.el9.noarc 256 kB/s | 15 kB 00:00 2023-11-19T00:37:02.669 INFO:teuthology.orchestra.run.smithi046.stdout:(27/130): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 1.9 MB/s | 133 kB 00:00 2023-11-19T00:37:02.688 INFO:teuthology.orchestra.run.smithi099.stdout:(97/130): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2023-11-19T00:37:02.747 INFO:teuthology.orchestra.run.smithi099.stdout:(98/130): python3-google-auth-2.23.4-1.el9.noar 3.3 MB/s | 197 kB 00:00 2023-11-19T00:37:02.806 INFO:teuthology.orchestra.run.smithi099.stdout:(99/130): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2023-11-19T00:37:02.823 INFO:teuthology.orchestra.run.smithi181.stdout:(70/130): python3-scipy-1.6.2-8.el9.x86_64.rpm 75 MB/s | 16 MB 00:00 2023-11-19T00:37:02.847 INFO:teuthology.orchestra.run.smithi099.stdout:(100/130): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2023-11-19T00:37:02.856 INFO:teuthology.orchestra.run.smithi181.stdout:(71/130): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-19T00:37:02.873 INFO:teuthology.orchestra.run.smithi099.stdout:(101/130): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2023-11-19T00:37:02.890 INFO:teuthology.orchestra.run.smithi181.stdout:(72/130): socat-1.7.4.1-5.el9.x86_64.rpm 8.8 MB/s | 300 kB 00:00 2023-11-19T00:37:02.898 INFO:teuthology.orchestra.run.smithi099.stdout:(102/130): python3-jaraco-collections-3.0.0-8.e 458 kB/s | 23 kB 00:00 2023-11-19T00:37:02.922 INFO:teuthology.orchestra.run.smithi073.stdout:(130/130): librados2-18.0.0-7418.gb0f45a51.el9. 2.8 MB/s | 3.3 MB 00:01 2023-11-19T00:37:02.923 INFO:teuthology.orchestra.run.smithi099.stdout:(103/130): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2023-11-19T00:37:02.924 INFO:teuthology.orchestra.run.smithi181.stdout:(73/130): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.5 MB/s | 85 kB 00:00 2023-11-19T00:37:02.926 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:37:02.926 INFO:teuthology.orchestra.run.smithi073.stdout:Total 11 MB/s | 186 MB 00:16 2023-11-19T00:37:02.943 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-11-19T00:37:02.957 INFO:teuthology.orchestra.run.smithi099.stdout:(104/130): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2023-11-19T00:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout:(74/130): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-19T00:37:02.982 INFO:teuthology.orchestra.run.smithi099.stdout:(105/130): python3-jwt+crypto-2.4.0-1.el9.noarc 155 kB/s | 9.0 kB 00:00 2023-11-19T00:37:02.991 INFO:teuthology.orchestra.run.smithi181.stdout:(75/130): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-19T00:37:03.016 INFO:teuthology.orchestra.run.smithi099.stdout:(106/130): python3-jwt-2.4.0-1.el9.noarch.rpm 697 kB/s | 41 kB 00:00 2023-11-19T00:37:03.024 INFO:teuthology.orchestra.run.smithi181.stdout:(76/130): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-11-19T00:37:03.067 INFO:teuthology.orchestra.run.smithi181.stdout:(77/130): libgfortran-11.4.1-2.3.el9.x86_64.rpm 19 MB/s | 803 kB 00:00 2023-11-19T00:37:03.083 INFO:teuthology.orchestra.run.smithi099.stdout:(107/130): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2023-11-19T00:37:03.099 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-11-19T00:37:03.099 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-11-19T00:37:03.100 INFO:teuthology.orchestra.run.smithi181.stdout:(78/130): libquadmath-11.4.1-2.3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2023-11-19T00:37:03.108 INFO:teuthology.orchestra.run.smithi099.stdout:(108/130): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2023-11-19T00:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout:(79/130): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.1 MB/s | 241 kB 00:00 2023-11-19T00:37:03.139 INFO:teuthology.orchestra.run.smithi099.stdout:(109/130): python3-more-itertools-8.12.0-2.el9. 1.4 MB/s | 79 kB 00:00 2023-11-19T00:37:03.165 INFO:teuthology.orchestra.run.smithi099.stdout:(110/130): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2023-11-19T00:37:03.169 INFO:teuthology.orchestra.run.smithi046.stdout:(28/130): ceph-mgr-dashboard-18.0.0-7418.gb0f45 3.5 MB/s | 1.8 MB 00:00 2023-11-19T00:37:03.176 INFO:teuthology.orchestra.run.smithi181.stdout:(80/130): python3-cryptography-36.0.1-4.el9.x86 28 MB/s | 1.1 MB 00:00 2023-11-19T00:37:03.198 INFO:teuthology.orchestra.run.smithi099.stdout:(111/130): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2023-11-19T00:37:03.210 INFO:teuthology.orchestra.run.smithi181.stdout:(81/130): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-11-19T00:37:03.223 INFO:teuthology.orchestra.run.smithi099.stdout:(112/130): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2023-11-19T00:37:03.236 INFO:teuthology.orchestra.run.smithi046.stdout:(29/130): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 3.6 MB/s | 3.0 MB 00:00 2023-11-19T00:37:03.257 INFO:teuthology.orchestra.run.smithi099.stdout:(113/130): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2023-11-19T00:37:03.282 INFO:teuthology.orchestra.run.smithi099.stdout:(114/130): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2023-11-19T00:37:03.316 INFO:teuthology.orchestra.run.smithi099.stdout:(115/130): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2023-11-19T00:37:03.318 INFO:teuthology.orchestra.run.smithi181.stdout:(82/130): ceph-mgr-diskprediction-local-18.0.0- 2.8 MB/s | 7.4 MB 00:02 2023-11-19T00:37:03.341 INFO:teuthology.orchestra.run.smithi099.stdout:(116/130): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-11-19T00:37:03.352 INFO:teuthology.orchestra.run.smithi181.stdout:(83/130): python3-pycparser-2.20-6.el9.noarch.r 873 kB/s | 124 kB 00:00 2023-11-19T00:37:03.361 INFO:teuthology.orchestra.run.smithi046.stdout:(30/130): ceph-mgr-modules-core-18.0.0-7418.gb0 1.9 MB/s | 243 kB 00:00 2023-11-19T00:37:03.375 INFO:teuthology.orchestra.run.smithi099.stdout:(117/130): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2023-11-19T00:37:03.377 INFO:teuthology.orchestra.run.smithi181.stdout:(84/130): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-11-19T00:37:03.400 INFO:teuthology.orchestra.run.smithi099.stdout:(118/130): python3-typing-extensions-4.4.0-2.el 873 kB/s | 51 kB 00:00 2023-11-19T00:37:03.403 INFO:teuthology.orchestra.run.smithi181.stdout:(85/130): python3-urllib3-1.26.5-4.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-11-19T00:37:03.428 INFO:teuthology.orchestra.run.smithi046.stdout:(31/130): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 753 kB/s | 50 kB 00:00 2023-11-19T00:37:03.433 INFO:teuthology.orchestra.run.smithi099.stdout:(119/130): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2023-11-19T00:37:03.459 INFO:teuthology.orchestra.run.smithi099.stdout:(120/130): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-11-19T00:37:03.487 INFO:teuthology.orchestra.run.smithi046.stdout:(32/130): ceph-prometheus-alerts-18.0.0-7418.gb 259 kB/s | 15 kB 00:00 2023-11-19T00:37:03.492 INFO:teuthology.orchestra.run.smithi099.stdout:(121/130): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2023-11-19T00:37:03.518 INFO:teuthology.orchestra.run.smithi099.stdout:(122/130): python3-zc-lockfile-2.0-10.el9.noarc 339 kB/s | 20 kB 00:00 2023-11-19T00:37:03.552 INFO:teuthology.orchestra.run.smithi099.stdout:(123/130): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-11-19T00:37:03.595 INFO:teuthology.orchestra.run.smithi046.stdout:(33/130): ceph-volume-18.0.0-7418.gb0f45a51.el9 2.4 MB/s | 262 kB 00:00 2023-11-19T00:37:03.703 INFO:teuthology.orchestra.run.smithi181.stdout:(86/130): ceph-common-18.0.0-7418.gb0f45a51.el9 1.3 MB/s | 19 MB 00:14 2023-11-19T00:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout:(87/130): python3-devel-3.9.17-2.el9.x86_64.rpm 700 kB/s | 245 kB 00:00 2023-11-19T00:37:03.829 INFO:teuthology.orchestra.run.smithi046.stdout:(34/130): cephadm-18.0.0-7418.gb0f45a51.el9.noa 3.2 MB/s | 774 kB 00:00 2023-11-19T00:37:03.868 INFO:teuthology.orchestra.run.smithi099.stdout:(124/130): thrift-0.15.0-2.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2023-11-19T00:37:03.903 INFO:teuthology.orchestra.run.smithi181.stdout:(88/130): gperftools-libs-2.9.1-2.el9.x86_64.rp 617 kB/s | 309 kB 00:00 2023-11-19T00:37:03.920 INFO:teuthology.orchestra.run.smithi181.stdout:(89/130): libarrow-doc-9.0.0-9.el9.noarch.rpm 127 kB/s | 24 kB 00:00 2023-11-19T00:37:03.946 INFO:teuthology.orchestra.run.smithi046.stdout:(35/130): automake-1.16.2-8.el9.noarch.rpm 5.6 MB/s | 662 kB 00:00 2023-11-19T00:37:03.979 INFO:teuthology.orchestra.run.smithi181.stdout:(90/130): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2023-11-19T00:37:03.996 INFO:teuthology.orchestra.run.smithi046.stdout:(36/130): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2023-11-19T00:37:04.030 INFO:teuthology.orchestra.run.smithi046.stdout:(37/130): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-19T00:37:04.064 INFO:teuthology.orchestra.run.smithi046.stdout:(38/130): elfutils-libelf-devel-0.190-1.el9.x86 645 kB/s | 21 kB 00:00 2023-11-19T00:37:04.071 INFO:teuthology.orchestra.run.smithi181.stdout:(91/130): libunwind-1.6.2-1.el9.x86_64.rpm 448 kB/s | 67 kB 00:00 2023-11-19T00:37:04.097 INFO:teuthology.orchestra.run.smithi046.stdout:(39/130): flex-2.6.4-9.el9.x86_64.rpm 9.0 MB/s | 307 kB 00:00 2023-11-19T00:37:04.131 INFO:teuthology.orchestra.run.smithi046.stdout:(40/130): flexiblas-3.0.4-8.el9.x86_64.rpm 954 kB/s | 32 kB 00:00 2023-11-19T00:37:04.180 INFO:teuthology.orchestra.run.smithi181.stdout:(92/130): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.1 MB/s | 837 kB 00:00 2023-11-19T00:37:04.206 INFO:teuthology.orchestra.run.smithi046.stdout:(41/130): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2023-11-19T00:37:04.210 INFO:teuthology.orchestra.run.smithi099.stdout:(125/130): librados2-18.0.0-7418.gb0f45a51.el9. 5.0 MB/s | 3.3 MB 00:00 2023-11-19T00:37:04.240 INFO:teuthology.orchestra.run.smithi046.stdout:(42/130): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2023-11-19T00:37:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:(126/130): elfutils-debuginfod-client-0.190-1.e 884 kB/s | 36 kB 00:00 2023-11-19T00:37:04.274 INFO:teuthology.orchestra.run.smithi046.stdout:(43/130): jq-1.6-16.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-11-19T00:37:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:(127/130): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-11-19T00:37:04.296 INFO:teuthology.orchestra.run.smithi181.stdout:(93/130): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 373 kB/s | 43 kB 00:00 2023-11-19T00:37:04.307 INFO:teuthology.orchestra.run.smithi046.stdout:(44/130): libaio-devel-0.3.111-13.el9.x86_64.rp 304 kB/s | 10 kB 00:00 2023-11-19T00:37:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:(128/130): elfutils-libs-0.190-1.el9.x86_64.rpm 6.0 MB/s | 255 kB 00:00 2023-11-19T00:37:04.341 INFO:teuthology.orchestra.run.smithi046.stdout:(45/130): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-11-19T00:37:04.372 INFO:teuthology.orchestra.run.smithi181.stdout:(94/130): libarrow-9.0.0-9.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2023-11-19T00:37:04.374 INFO:teuthology.orchestra.run.smithi046.stdout:(46/130): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-19T00:37:04.416 INFO:teuthology.orchestra.run.smithi046.stdout:(47/130): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2023-11-19T00:37:04.422 INFO:teuthology.orchestra.run.smithi181.stdout:(95/130): python3-cachetools-4.2.4-1.el9.noarch 257 kB/s | 32 kB 00:00 2023-11-19T00:37:04.455 INFO:teuthology.orchestra.run.smithi181.stdout:(96/130): python3-certifi-2021.10.8-2.el9.noarc 179 kB/s | 15 kB 00:00 2023-11-19T00:37:04.458 INFO:teuthology.orchestra.run.smithi046.stdout:(48/130): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-11-19T00:37:04.492 INFO:teuthology.orchestra.run.smithi046.stdout:(49/130): libuuid-devel-2.37.4-15.el9.x86_64.rp 733 kB/s | 24 kB 00:00 2023-11-19T00:37:04.514 INFO:teuthology.orchestra.run.smithi181.stdout:(97/130): python3-cheroot-8.6.0-4.el9.noarch.rp 1.8 MB/s | 172 kB 00:00 2023-11-19T00:37:04.525 INFO:teuthology.orchestra.run.smithi046.stdout:(50/130): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-19T00:37:04.539 INFO:teuthology.orchestra.run.smithi181.stdout:(98/130): python3-asyncssh-2.13.2-3.el9.noarch. 1.1 MB/s | 548 kB 00:00 2023-11-19T00:37:04.559 INFO:teuthology.orchestra.run.smithi046.stdout:(51/130): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-11-19T00:37:04.593 INFO:teuthology.orchestra.run.smithi046.stdout:(52/130): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-11-19T00:37:04.606 INFO:teuthology.orchestra.run.smithi181.stdout:(99/130): python3-cherrypy-18.6.1-2.el9.noarch. 2.3 MB/s | 358 kB 00:00 2023-11-19T00:37:04.626 INFO:teuthology.orchestra.run.smithi046.stdout:(53/130): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-11-19T00:37:04.632 INFO:teuthology.orchestra.run.smithi181.stdout:(100/130): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2023-11-19T00:37:04.657 INFO:teuthology.orchestra.run.smithi181.stdout:(101/130): python3-google-auth-2.23.4-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-11-19T00:37:04.699 INFO:teuthology.orchestra.run.smithi181.stdout:(102/130): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2023-11-19T00:37:04.710 INFO:teuthology.orchestra.run.smithi046.stdout:(54/130): openblas-openmp-0.3.21-2.el9.x86_64.r 57 MB/s | 4.7 MB 00:00 2023-11-19T00:37:04.718 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-11-19T00:37:04.718 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-11-19T00:37:04.724 INFO:teuthology.orchestra.run.smithi181.stdout:(103/130): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2023-11-19T00:37:04.749 INFO:teuthology.orchestra.run.smithi181.stdout:(104/130): python3-jaraco-functools-3.5.0-2.el9 210 kB/s | 19 kB 00:00 2023-11-19T00:37:04.777 INFO:teuthology.orchestra.run.smithi046.stdout:(55/130): openssl-devel-3.0.7-24.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2023-11-19T00:37:04.791 INFO:teuthology.orchestra.run.smithi181.stdout:(105/130): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2023-11-19T00:37:04.845 INFO:teuthology.orchestra.run.smithi099.stdout:(129/130): ceph-test-18.0.0-7418.gb0f45a51.el9. 3.5 MB/s | 41 MB 00:11 2023-11-19T00:37:04.883 INFO:teuthology.orchestra.run.smithi181.stdout:(106/130): python3-jwt+crypto-2.4.0-1.el9.noarc 57 kB/s | 9.0 kB 00:00 2023-11-19T00:37:04.903 INFO:teuthology.orchestra.run.smithi099.stdout:(130/130): librbd1-18.0.0-7418.gb0f45a51.el9.x8 2.9 MB/s | 3.0 MB 00:01 2023-11-19T00:37:04.910 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:37:04.910 INFO:teuthology.orchestra.run.smithi099.stdout:Total 11 MB/s | 186 MB 00:17 2023-11-19T00:37:04.929 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-11-19T00:37:04.992 INFO:teuthology.orchestra.run.smithi181.stdout:(107/130): python3-jwt-2.4.0-1.el9.noarch.rpm 169 kB/s | 41 kB 00:00 2023-11-19T00:37:05.002 INFO:teuthology.orchestra.run.smithi046.stdout:(56/130): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 5.8 MB 00:00 2023-11-19T00:37:05.044 INFO:teuthology.orchestra.run.smithi046.stdout:(57/130): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-11-19T00:37:05.070 INFO:teuthology.orchestra.run.smithi046.stdout:(58/130): python3-jsonpatch-1.21-16.el9.noarch. 986 kB/s | 24 kB 00:00 2023-11-19T00:37:05.075 INFO:teuthology.orchestra.run.smithi181.stdout:(108/130): python3-logutils-0.3.5-21.el9.noarch 241 kB/s | 46 kB 00:00 2023-11-19T00:37:05.082 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-11-19T00:37:05.082 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-11-19T00:37:05.095 INFO:teuthology.orchestra.run.smithi046.stdout:(59/130): python3-jsonpointer-2.0-4.el9.noarch. 721 kB/s | 18 kB 00:00 2023-11-19T00:37:05.129 INFO:teuthology.orchestra.run.smithi046.stdout:(60/130): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-11-19T00:37:05.134 INFO:teuthology.orchestra.run.smithi181.stdout:(109/130): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2023-11-19T00:37:05.160 INFO:teuthology.orchestra.run.smithi181.stdout:(110/130): python3-more-itertools-8.12.0-2.el9. 471 kB/s | 79 kB 00:00 2023-11-19T00:37:05.162 INFO:teuthology.orchestra.run.smithi046.stdout:(61/130): python3-markupsafe-1.1.1-12.el9.x86_6 943 kB/s | 32 kB 00:00 2023-11-19T00:37:05.193 INFO:teuthology.orchestra.run.smithi181.stdout:(111/130): python3-natsort-7.1.1-5.el9.noarch.r 491 kB/s | 58 kB 00:00 2023-11-19T00:37:05.252 INFO:teuthology.orchestra.run.smithi181.stdout:(112/130): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2023-11-19T00:37:05.254 INFO:teuthology.orchestra.run.smithi046.stdout:(62/130): python3-numpy-1.20.1-5.el9.x86_64.rpm 52 MB/s | 4.8 MB 00:00 2023-11-19T00:37:05.277 INFO:teuthology.orchestra.run.smithi181.stdout:(113/130): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2023-11-19T00:37:05.288 INFO:teuthology.orchestra.run.smithi046.stdout:(63/130): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.4 MB/s | 217 kB 00:00 2023-11-19T00:37:05.302 INFO:teuthology.orchestra.run.smithi181.stdout:(114/130): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2023-11-19T00:37:05.336 INFO:teuthology.orchestra.run.smithi181.stdout:(115/130): python3-repoze-lru-0.7-16.el9.noarch 366 kB/s | 31 kB 00:00 2023-11-19T00:37:05.370 INFO:teuthology.orchestra.run.smithi181.stdout:(116/130): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-11-19T00:37:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:(64/130): ceph-mgr-diskprediction-local-18.0.0- 3.3 MB/s | 7.4 MB 00:02 2023-11-19T00:37:05.395 INFO:teuthology.orchestra.run.smithi181.stdout:(117/130): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2023-11-19T00:37:05.415 INFO:teuthology.orchestra.run.smithi046.stdout:(65/130): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-11-19T00:37:05.420 INFO:teuthology.orchestra.run.smithi181.stdout:(118/130): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2023-11-19T00:37:05.440 INFO:teuthology.orchestra.run.smithi046.stdout:(66/130): python3-prettytable-0.7.2-27.el9.noar 829 kB/s | 41 kB 00:00 2023-11-19T00:37:05.445 INFO:teuthology.orchestra.run.smithi181.stdout:(119/130): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2023-11-19T00:37:05.465 INFO:teuthology.orchestra.run.smithi046.stdout:(67/130): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-19T00:37:05.491 INFO:teuthology.orchestra.run.smithi046.stdout:(68/130): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-11-19T00:37:05.496 INFO:teuthology.orchestra.run.smithi181.stdout:(120/130): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-11-19T00:37:05.516 INFO:teuthology.orchestra.run.smithi046.stdout:(69/130): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2023-11-19T00:37:05.521 INFO:teuthology.orchestra.run.smithi181.stdout:(121/130): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-11-19T00:37:05.541 INFO:teuthology.orchestra.run.smithi046.stdout:(70/130): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2023-11-19T00:37:05.546 INFO:teuthology.orchestra.run.smithi181.stdout:(122/130): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2023-11-19T00:37:05.572 INFO:teuthology.orchestra.run.smithi181.stdout:(123/130): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2023-11-19T00:37:05.592 INFO:teuthology.orchestra.run.smithi046.stdout:(71/130): python3-toml-0.10.2-6.el9.noarch.rpm 820 kB/s | 39 kB 00:00 2023-11-19T00:37:05.655 INFO:teuthology.orchestra.run.smithi181.stdout:(124/130): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-11-19T00:37:05.739 INFO:teuthology.orchestra.run.smithi181.stdout:(125/130): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2023-11-19T00:37:05.759 INFO:teuthology.orchestra.run.smithi046.stdout:(72/130): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-11-19T00:37:05.772 INFO:teuthology.orchestra.run.smithi181.stdout:(126/130): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-11-19T00:37:05.784 INFO:teuthology.orchestra.run.smithi046.stdout:(73/130): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2023-11-19T00:37:05.806 INFO:teuthology.orchestra.run.smithi181.stdout:(127/130): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-11-19T00:37:05.817 INFO:teuthology.orchestra.run.smithi046.stdout:(74/130): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.5 MB/s | 85 kB 00:00 2023-11-19T00:37:05.840 INFO:teuthology.orchestra.run.smithi181.stdout:(128/130): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-11-19T00:37:05.842 INFO:teuthology.orchestra.run.smithi046.stdout:(75/130): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-11-19T00:37:05.876 INFO:teuthology.orchestra.run.smithi046.stdout:(76/130): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-19T00:37:05.901 INFO:teuthology.orchestra.run.smithi046.stdout:(77/130): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-19T00:37:05.935 INFO:teuthology.orchestra.run.smithi046.stdout:(78/130): libgfortran-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2023-11-19T00:37:05.960 INFO:teuthology.orchestra.run.smithi046.stdout:(79/130): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.4 MB/s | 195 kB 00:00 2023-11-19T00:37:05.981 INFO:teuthology.orchestra.run.smithi181.stdout:(129/130): librbd1-18.0.0-7418.gb0f45a51.el9.x8 9.3 MB/s | 3.0 MB 00:00 2023-11-19T00:37:05.985 INFO:teuthology.orchestra.run.smithi046.stdout:(80/130): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-19T00:37:06.019 INFO:teuthology.orchestra.run.smithi046.stdout:(81/130): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2023-11-19T00:37:06.044 INFO:teuthology.orchestra.run.smithi046.stdout:(82/130): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-11-19T00:37:06.070 INFO:teuthology.orchestra.run.smithi046.stdout:(83/130): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-11-19T00:37:06.095 INFO:teuthology.orchestra.run.smithi046.stdout:(84/130): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-11-19T00:37:06.120 INFO:teuthology.orchestra.run.smithi046.stdout:(85/130): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-19T00:37:06.523 INFO:teuthology.orchestra.run.smithi181.stdout:(130/130): librados2-18.0.0-7418.gb0f45a51.el9. 3.5 MB/s | 3.3 MB 00:00 2023-11-19T00:37:06.527 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:37:06.527 INFO:teuthology.orchestra.run.smithi181.stdout:Total 10 MB/s | 186 MB 00:17 2023-11-19T00:37:06.546 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2023-11-19T00:37:06.604 INFO:teuthology.orchestra.run.smithi046.stdout:(86/130): ceph-test-18.0.0-7418.gb0f45a51.el9.x 3.7 MB/s | 41 MB 00:11 2023-11-19T00:37:06.662 INFO:teuthology.orchestra.run.smithi046.stdout:(87/130): python3-devel-3.9.17-2.el9.x86_64.rpm 433 kB/s | 245 kB 00:00 2023-11-19T00:37:06.703 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2023-11-19T00:37:06.704 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2023-11-19T00:37:06.728 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-11-19T00:37:06.728 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-11-19T00:37:07.554 INFO:teuthology.orchestra.run.smithi046.stdout:(88/130): libarrow-doc-9.0.0-9.el9.noarch.rpm 27 kB/s | 24 kB 00:00 2023-11-19T00:37:08.055 INFO:teuthology.orchestra.run.smithi046.stdout:(89/130): gperftools-libs-2.9.1-2.el9.x86_64.rp 160 kB/s | 309 kB 00:01 2023-11-19T00:37:08.096 INFO:teuthology.orchestra.run.smithi046.stdout:(90/130): liboath-2.6.7-2.el9.x86_64.rpm 90 kB/s | 49 kB 00:00 2023-11-19T00:37:08.305 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2023-11-19T00:37:08.305 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2023-11-19T00:37:08.322 INFO:teuthology.orchestra.run.smithi046.stdout:(91/130): libunwind-1.6.2-1.el9.x86_64.rpm 253 kB/s | 67 kB 00:00 2023-11-19T00:37:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:(92/130): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.3 MB/s | 837 kB 00:00 2023-11-19T00:37:08.805 INFO:teuthology.orchestra.run.smithi046.stdout:(93/130): python3-asyncssh-2.13.2-3.el9.noarch. 1.1 MB/s | 548 kB 00:00 2023-11-19T00:37:08.989 INFO:teuthology.orchestra.run.smithi046.stdout:(94/130): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 153 kB/s | 43 kB 00:00 2023-11-19T00:37:09.039 INFO:teuthology.orchestra.run.smithi046.stdout:(95/130): python3-cachetools-4.2.4-1.el9.noarch 138 kB/s | 32 kB 00:00 2023-11-19T00:37:09.106 INFO:teuthology.orchestra.run.smithi046.stdout:(96/130): libarrow-9.0.0-9.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2023-11-19T00:37:09.223 INFO:teuthology.orchestra.run.smithi046.stdout:(97/130): python3-certifi-2021.10.8-2.el9.noarc 65 kB/s | 15 kB 00:00 2023-11-19T00:37:09.290 INFO:teuthology.orchestra.run.smithi046.stdout:(98/130): python3-cheroot-8.6.0-4.el9.noarch.rp 688 kB/s | 172 kB 00:00 2023-11-19T00:37:09.374 INFO:teuthology.orchestra.run.smithi046.stdout:(99/130): python3-cherrypy-18.6.1-2.el9.noarch. 1.3 MB/s | 358 kB 00:00 2023-11-19T00:37:09.474 INFO:teuthology.orchestra.run.smithi046.stdout:(100/130): python3-google-auth-2.23.4-1.el9.noa 789 kB/s | 197 kB 00:00 2023-11-19T00:37:09.524 INFO:teuthology.orchestra.run.smithi046.stdout:(101/130): python3-jaraco-8.2.1-3.el9.noarch.rp 46 kB/s | 11 kB 00:00 2023-11-19T00:37:09.608 INFO:teuthology.orchestra.run.smithi046.stdout:(102/130): python3-jaraco-classes-3.2.1-5.el9.n 76 kB/s | 18 kB 00:00 2023-11-19T00:37:09.708 INFO:teuthology.orchestra.run.smithi046.stdout:(103/130): python3-jaraco-collections-3.0.0-8.e 99 kB/s | 23 kB 00:00 2023-11-19T00:37:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:(104/130): python3-jaraco-functools-3.5.0-2.el9 83 kB/s | 19 kB 00:00 2023-11-19T00:37:09.842 INFO:teuthology.orchestra.run.smithi046.stdout:(105/130): python3-jaraco-text-3.2.0-6.el9.noar 84 kB/s | 20 kB 00:00 2023-11-19T00:37:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-11-19T00:37:09.934 INFO:teuthology.orchestra.run.smithi046.stdout:(106/130): python3-jwt+crypto-2.4.0-1.el9.noarc 40 kB/s | 9.0 kB 00:00 2023-11-19T00:37:09.958 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/135 2023-11-19T00:37:09.992 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/135 2023-11-19T00:37:09.992 INFO:teuthology.orchestra.run.smithi046.stdout:(107/130): python3-jwt-2.4.0-1.el9.noarch.rpm 175 kB/s | 41 kB 00:00 2023-11-19T00:37:10.146 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/135 2023-11-19T00:37:10.176 INFO:teuthology.orchestra.run.smithi046.stdout:(108/130): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2023-11-19T00:37:10.201 INFO:teuthology.orchestra.run.smithi046.stdout:(109/130): python3-logutils-0.3.5-21.el9.noarch 173 kB/s | 46 kB 00:00 2023-11-19T00:37:10.226 INFO:teuthology.orchestra.run.smithi046.stdout:(110/130): python3-more-itertools-8.12.0-2.el9. 337 kB/s | 79 kB 00:00 2023-11-19T00:37:10.418 INFO:teuthology.orchestra.run.smithi046.stdout:(111/130): python3-natsort-7.1.1-5.el9.noarch.r 238 kB/s | 58 kB 00:00 2023-11-19T00:37:10.477 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/135 2023-11-19T00:37:10.535 INFO:teuthology.orchestra.run.smithi046.stdout:(112/130): python3-pecan-1.4.2-3.el9.noarch.rpm 816 kB/s | 272 kB 00:00 2023-11-19T00:37:10.542 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:10.552 INFO:teuthology.orchestra.run.smithi046.stdout:(113/130): python3-portend-3.1.0-2.el9.noarch.r 50 kB/s | 16 kB 00:00 2023-11-19T00:37:10.653 INFO:teuthology.orchestra.run.smithi046.stdout:(114/130): python3-pyOpenSSL-21.0.0-1.el9.noarc 385 kB/s | 90 kB 00:00 2023-11-19T00:37:10.662 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:10.702 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:10.761 INFO:teuthology.orchestra.run.smithi046.stdout:(115/130): python3-repoze-lru-0.7-16.el9.noarch 136 kB/s | 31 kB 00:00 2023-11-19T00:37:10.785 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:(116/130): python3-routes-2.5.1-5.el9.noarch.rp 779 kB/s | 188 kB 00:00 2023-11-19T00:37:10.844 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:37:10.873 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/135 2023-11-19T00:37:10.886 INFO:teuthology.orchestra.run.smithi046.stdout:(117/130): python3-rsa-4.9-2.el9.noarch.rpm 253 kB/s | 59 kB 00:00 2023-11-19T00:37:10.912 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/135 2023-11-19T00:37:10.970 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/135 2023-11-19T00:37:10.987 INFO:teuthology.orchestra.run.smithi046.stdout:(118/130): python3-tempora-5.0.0-2.el9.noarch.r 159 kB/s | 36 kB 00:00 2023-11-19T00:37:10.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:11.045 INFO:teuthology.orchestra.run.smithi046.stdout:(119/130): python3-typing-extensions-4.4.0-2.el 204 kB/s | 51 kB 00:00 2023-11-19T00:37:11.099 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:11.123 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:11.137 INFO:teuthology.orchestra.run.smithi046.stdout:(120/130): python3-webob-1.8.7-6.el9.noarch.rpm 917 kB/s | 230 kB 00:00 2023-11-19T00:37:11.221 INFO:teuthology.orchestra.run.smithi046.stdout:(121/130): python3-websocket-client-1.2.3-2.el9 383 kB/s | 90 kB 00:00 2023-11-19T00:37:11.250 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:11.286 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/135 2023-11-19T00:37:11.313 INFO:teuthology.orchestra.run.smithi046.stdout:(122/130): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2023-11-19T00:37:11.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/135 2023-11-19T00:37:11.363 INFO:teuthology.orchestra.run.smithi046.stdout:(123/130): python3-zc-lockfile-2.0-10.el9.noarc 89 kB/s | 20 kB 00:00 2023-11-19T00:37:11.408 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 15/135 2023-11-19T00:37:11.446 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 16/135 2023-11-19T00:37:11.463 INFO:teuthology.orchestra.run.smithi046.stdout:(124/130): re2-20211101-3.el9.x86_64.rpm 792 kB/s | 192 kB 00:00 2023-11-19T00:37:11.483 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 17/135 2023-11-19T00:37:11.524 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 18/135 2023-11-19T00:37:11.613 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/135 2023-11-19T00:37:11.647 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/135 2023-11-19T00:37:11.672 INFO:teuthology.orchestra.run.smithi046.stdout:(125/130): thrift-0.15.0-2.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2023-11-19T00:37:11.675 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/135 2023-11-19T00:37:11.705 INFO:teuthology.orchestra.run.smithi046.stdout:(126/130): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-11-19T00:37:11.727 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-11-19T00:37:11.739 INFO:teuthology.orchestra.run.smithi046.stdout:(127/130): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-11-19T00:37:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/135 2023-11-19T00:37:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 23/135 2023-11-19T00:37:11.772 INFO:teuthology.orchestra.run.smithi046.stdout:(128/130): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-11-19T00:37:11.788 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/135 2023-11-19T00:37:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 24/135 2023-11-19T00:37:11.813 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/135 2023-11-19T00:37:11.871 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/135 2023-11-19T00:37:11.888 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 25/135 2023-11-19T00:37:12.023 INFO:teuthology.orchestra.run.smithi046.stdout:(129/130): librados2-18.0.0-7418.gb0f45a51.el9. 5.0 MB/s | 3.3 MB 00:00 2023-11-19T00:37:12.024 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/135 2023-11-19T00:37:12.084 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/135 2023-11-19T00:37:12.206 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/135 2023-11-19T00:37:12.256 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:12.290 INFO:teuthology.orchestra.run.smithi046.stdout:(130/130): librbd1-18.0.0-7418.gb0f45a51.el9.x8 3.7 MB/s | 3.0 MB 00:00 2023-11-19T00:37:12.296 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-11-19T00:37:12.296 INFO:teuthology.orchestra.run.smithi046.stdout:Total 7.3 MB/s | 186 MB 00:25 2023-11-19T00:37:12.316 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2023-11-19T00:37:12.375 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:12.491 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2023-11-19T00:37:12.492 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2023-11-19T00:37:12.601 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/135 2023-11-19T00:37:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:12.688 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/135 2023-11-19T00:37:12.727 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 30/135 2023-11-19T00:37:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:37:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 31/135 2023-11-19T00:37:12.770 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/135 2023-11-19T00:37:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 32/135 2023-11-19T00:37:12.809 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/135 2023-11-19T00:37:12.837 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 33/135 2023-11-19T00:37:12.866 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/135 2023-11-19T00:37:12.886 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:12.943 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-3.el9.x86_64 34/135 2023-11-19T00:37:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:12.982 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 35/135 2023-11-19T00:37:12.995 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:13.037 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 36/135 2023-11-19T00:37:13.112 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 37/135 2023-11-19T00:37:13.124 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:13.150 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 38/135 2023-11-19T00:37:13.157 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/135 2023-11-19T00:37:13.186 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 39/135 2023-11-19T00:37:13.226 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/135 2023-11-19T00:37:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 40/135 2023-11-19T00:37:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 41/135 2023-11-19T00:37:13.280 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 15/135 2023-11-19T00:37:13.315 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 16/135 2023-11-19T00:37:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 42/135 2023-11-19T00:37:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 17/135 2023-11-19T00:37:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 18/135 2023-11-19T00:37:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2023-11-19T00:37:13.449 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/135 2023-11-19T00:37:13.455 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 43/135 2023-11-19T00:37:13.485 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/135 2023-11-19T00:37:13.498 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 44/135 2023-11-19T00:37:13.512 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/135 2023-11-19T00:37:13.539 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 45/135 2023-11-19T00:37:13.569 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/135 2023-11-19T00:37:13.581 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/135 2023-11-19T00:37:13.605 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/135 2023-11-19T00:37:13.617 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 23/135 2023-11-19T00:37:13.633 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 46/135 2023-11-19T00:37:13.661 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 24/135 2023-11-19T00:37:13.661 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/135 2023-11-19T00:37:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 47/135 2023-11-19T00:37:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 48/135 2023-11-19T00:37:13.733 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 25/135 2023-11-19T00:37:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 49/135 2023-11-19T00:37:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 50/135 2023-11-19T00:37:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 51/135 2023-11-19T00:37:13.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 52/135 2023-11-19T00:37:13.986 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 53/135 2023-11-19T00:37:13.988 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/135 2023-11-19T00:37:14.027 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/135 2023-11-19T00:37:14.038 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:14.088 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/135 2023-11-19T00:37:14.174 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 54/135 2023-11-19T00:37:14.206 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 55/135 2023-11-19T00:37:14.229 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2023-11-19T00:37:14.229 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2023-11-19T00:37:14.297 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:14.346 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:37:14.359 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 56/135 2023-11-19T00:37:14.377 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/135 2023-11-19T00:37:14.398 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 57/135 2023-11-19T00:37:14.427 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 58/135 2023-11-19T00:37:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/135 2023-11-19T00:37:14.452 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 59/135 2023-11-19T00:37:14.485 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 60/135 2023-11-19T00:37:14.506 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/135 2023-11-19T00:37:14.515 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 61/135 2023-11-19T00:37:14.525 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 62/135 2023-11-19T00:37:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/135 2023-11-19T00:37:14.608 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/135 2023-11-19T00:37:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:14.622 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/135 2023-11-19T00:37:14.635 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:14.655 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/135 2023-11-19T00:37:14.691 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/135 2023-11-19T00:37:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/135 2023-11-19T00:37:14.735 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 30/135 2023-11-19T00:37:14.763 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:14.780 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 31/135 2023-11-19T00:37:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/135 2023-11-19T00:37:14.800 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/135 2023-11-19T00:37:14.809 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 32/135 2023-11-19T00:37:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/135 2023-11-19T00:37:14.840 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 33/135 2023-11-19T00:37:14.857 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/135 2023-11-19T00:37:14.868 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/135 2023-11-19T00:37:14.891 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/135 2023-11-19T00:37:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 15/135 2023-11-19T00:37:14.950 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-3.el9.x86_64 34/135 2023-11-19T00:37:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 16/135 2023-11-19T00:37:14.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/135 2023-11-19T00:37:14.985 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 35/135 2023-11-19T00:37:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 17/135 2023-11-19T00:37:15.027 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/135 2023-11-19T00:37:15.040 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 36/135 2023-11-19T00:37:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 18/135 2023-11-19T00:37:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/135 2023-11-19T00:37:15.113 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 37/135 2023-11-19T00:37:15.130 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/135 2023-11-19T00:37:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/135 2023-11-19T00:37:15.145 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 38/135 2023-11-19T00:37:15.181 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 39/135 2023-11-19T00:37:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/135 2023-11-19T00:37:15.228 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 40/135 2023-11-19T00:37:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/135 2023-11-19T00:37:15.273 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 41/135 2023-11-19T00:37:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 23/135 2023-11-19T00:37:15.315 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 42/135 2023-11-19T00:37:15.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 24/135 2023-11-19T00:37:15.347 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/135 2023-11-19T00:37:15.410 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 25/135 2023-11-19T00:37:15.449 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 43/135 2023-11-19T00:37:15.483 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 44/135 2023-11-19T00:37:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 45/135 2023-11-19T00:37:15.553 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/135 2023-11-19T00:37:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/135 2023-11-19T00:37:15.618 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 46/135 2023-11-19T00:37:15.650 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 47/135 2023-11-19T00:37:15.690 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 48/135 2023-11-19T00:37:15.723 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 49/135 2023-11-19T00:37:15.820 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 50/135 2023-11-19T00:37:15.868 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 51/135 2023-11-19T00:37:15.916 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 52/135 2023-11-19T00:37:15.972 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 53/135 2023-11-19T00:37:16.078 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/135 2023-11-19T00:37:16.123 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/135 2023-11-19T00:37:16.125 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/135 2023-11-19T00:37:16.159 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/135 2023-11-19T00:37:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 54/135 2023-11-19T00:37:16.191 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/135 2023-11-19T00:37:16.200 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/135 2023-11-19T00:37:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 55/135 2023-11-19T00:37:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 30/135 2023-11-19T00:37:16.298 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 31/135 2023-11-19T00:37:16.335 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 32/135 2023-11-19T00:37:16.343 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 56/135 2023-11-19T00:37:16.366 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 33/135 2023-11-19T00:37:16.368 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/135 2023-11-19T00:37:16.382 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 57/135 2023-11-19T00:37:16.398 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/135 2023-11-19T00:37:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 58/135 2023-11-19T00:37:16.445 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 59/135 2023-11-19T00:37:16.467 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/135 2023-11-19T00:37:16.472 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-3.el9.x86_64 34/135 2023-11-19T00:37:16.478 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 60/135 2023-11-19T00:37:16.508 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-15.el9.x86_64 61/135 2023-11-19T00:37:16.519 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 35/135 2023-11-19T00:37:16.536 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 62/135 2023-11-19T00:37:16.574 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 36/135 2023-11-19T00:37:16.581 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/135 2023-11-19T00:37:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/135 2023-11-19T00:37:16.646 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/135 2023-11-19T00:37:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 37/135 2023-11-19T00:37:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 38/135 2023-11-19T00:37:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 39/135 2023-11-19T00:37:16.738 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/135 2023-11-19T00:37:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 40/135 2023-11-19T00:37:16.772 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/135 2023-11-19T00:37:16.806 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/135 2023-11-19T00:37:16.807 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 41/135 2023-11-19T00:37:16.847 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/135 2023-11-19T00:37:16.849 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 42/135 2023-11-19T00:37:16.882 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/135 2023-11-19T00:37:16.978 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/135 2023-11-19T00:37:16.982 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 43/135 2023-11-19T00:37:17.017 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/135 2023-11-19T00:37:17.026 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 44/135 2023-11-19T00:37:17.067 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 45/135 2023-11-19T00:37:17.120 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/135 2023-11-19T00:37:17.138 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/135 2023-11-19T00:37:17.159 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 46/135 2023-11-19T00:37:17.168 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/135 2023-11-19T00:37:17.210 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 47/135 2023-11-19T00:37:17.246 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/135 2023-11-19T00:37:17.250 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 48/135 2023-11-19T00:37:17.282 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 49/135 2023-11-19T00:37:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 50/135 2023-11-19T00:37:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 51/135 2023-11-19T00:37:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 52/135 2023-11-19T00:37:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 53/135 2023-11-19T00:37:17.720 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 54/135 2023-11-19T00:37:17.773 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 55/135 2023-11-19T00:37:17.893 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/135 2023-11-19T00:37:17.910 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 56/135 2023-11-19T00:37:17.958 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 57/135 2023-11-19T00:37:17.987 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 58/135 2023-11-19T00:37:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/135 2023-11-19T00:37:18.030 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 59/135 2023-11-19T00:37:18.049 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/135 2023-11-19T00:37:18.063 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 60/135 2023-11-19T00:37:18.081 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/135 2023-11-19T00:37:18.092 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-15.el9.x86_64 61/135 2023-11-19T00:37:18.121 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 62/135 2023-11-19T00:37:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/135 2023-11-19T00:37:18.200 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/135 2023-11-19T00:37:18.230 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/135 2023-11-19T00:37:18.257 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/135 2023-11-19T00:37:18.288 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/135 2023-11-19T00:37:18.307 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/135 2023-11-19T00:37:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/135 2023-11-19T00:37:18.365 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/135 2023-11-19T00:37:18.373 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/135 2023-11-19T00:37:18.415 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/135 2023-11-19T00:37:18.449 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/135 2023-11-19T00:37:18.502 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/135 2023-11-19T00:37:18.539 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/135 2023-11-19T00:37:18.585 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/135 2023-11-19T00:37:18.589 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/135 2023-11-19T00:37:18.613 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/135 2023-11-19T00:37:18.643 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-16.el9.x86_64 87/135 2023-11-19T00:37:18.672 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/135 2023-11-19T00:37:18.688 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/135 2023-11-19T00:37:18.705 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 89/135 2023-11-19T00:37:18.736 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/135 2023-11-19T00:37:19.000 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/135 2023-11-19T00:37:19.018 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/135 2023-11-19T00:37:19.028 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:19.119 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:19.134 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/135 2023-11-19T00:37:19.149 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 92/135 2023-11-19T00:37:19.185 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/135 2023-11-19T00:37:19.479 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/135 2023-11-19T00:37:19.525 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/135 2023-11-19T00:37:19.550 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2023-11-19T00:37:19.558 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/135 2023-11-19T00:37:19.591 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/135 2023-11-19T00:37:19.604 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 94/135 2023-11-19T00:37:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/135 2023-11-19T00:37:19.631 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:19.642 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/135 2023-11-19T00:37:19.698 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/135 2023-11-19T00:37:19.702 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:19.732 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 96/135 2023-11-19T00:37:19.761 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/135 2023-11-19T00:37:19.981 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/135 2023-11-19T00:37:20.036 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/135 2023-11-19T00:37:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/135 2023-11-19T00:37:20.093 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:20.215 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/135 2023-11-19T00:37:20.253 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:20.345 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:20.381 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/135 2023-11-19T00:37:20.390 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:37:20.423 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/135 2023-11-19T00:37:20.461 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/135 2023-11-19T00:37:20.466 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/135 2023-11-19T00:37:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/135 2023-11-19T00:37:20.523 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-16.el9.x86_64 87/135 2023-11-19T00:37:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/135 2023-11-19T00:37:20.545 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/135 2023-11-19T00:37:20.568 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 89/135 2023-11-19T00:37:20.572 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:20.659 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:20.682 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:20.717 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/135 2023-11-19T00:37:20.812 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 12/135 2023-11-19T00:37:20.828 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/135 2023-11-19T00:37:20.853 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/135 2023-11-19T00:37:20.859 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/135 2023-11-19T00:37:20.890 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:20.924 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/135 2023-11-19T00:37:20.976 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 15/135 2023-11-19T00:37:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 92/135 2023-11-19T00:37:21.015 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 16/135 2023-11-19T00:37:21.047 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/135 2023-11-19T00:37:21.059 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 17/135 2023-11-19T00:37:21.098 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 18/135 2023-11-19T00:37:21.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/135 2023-11-19T00:37:21.206 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/135 2023-11-19T00:37:21.233 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/135 2023-11-19T00:37:21.305 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/135 2023-11-19T00:37:21.338 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 23/135 2023-11-19T00:37:21.382 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 24/135 2023-11-19T00:37:21.457 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 25/135 2023-11-19T00:37:21.471 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 94/135 2023-11-19T00:37:21.492 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:21.560 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 96/135 2023-11-19T00:37:21.596 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/135 2023-11-19T00:37:21.651 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/135 2023-11-19T00:37:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:22.066 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/135 2023-11-19T00:37:22.139 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/135 2023-11-19T00:37:22.171 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/135 2023-11-19T00:37:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jq-1.6-16.el9.x86_64 87/135 2023-11-19T00:37:22.209 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/135 2023-11-19T00:37:22.229 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/135 2023-11-19T00:37:22.254 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 89/135 2023-11-19T00:37:22.299 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/135 2023-11-19T00:37:22.350 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 30/135 2023-11-19T00:37:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 31/135 2023-11-19T00:37:22.430 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 32/135 2023-11-19T00:37:22.460 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 33/135 2023-11-19T00:37:22.557 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/135 2023-11-19T00:37:22.571 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 34/135 2023-11-19T00:37:22.593 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:22.606 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 35/135 2023-11-19T00:37:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:22.662 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 36/135 2023-11-19T00:37:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:22.710 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-19T00:37:22.710 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-19T00:37:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 92/135 2023-11-19T00:37:22.736 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 37/135 2023-11-19T00:37:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:22.752 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/135 2023-11-19T00:37:22.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 38/135 2023-11-19T00:37:22.811 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 39/135 2023-11-19T00:37:22.859 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 40/135 2023-11-19T00:37:22.903 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 41/135 2023-11-19T00:37:22.946 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 42/135 2023-11-19T00:37:23.085 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 43/135 2023-11-19T00:37:23.121 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 44/135 2023-11-19T00:37:23.164 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 45/135 2023-11-19T00:37:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 94/135 2023-11-19T00:37:23.239 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:23.260 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 46/135 2023-11-19T00:37:23.294 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:23.298 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 47/135 2023-11-19T00:37:23.324 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 96/135 2023-11-19T00:37:23.339 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 48/135 2023-11-19T00:37:23.371 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 49/135 2023-11-19T00:37:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 50/135 2023-11-19T00:37:23.516 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 51/135 2023-11-19T00:37:23.574 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 52/135 2023-11-19T00:37:23.629 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 53/135 2023-11-19T00:37:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:23.824 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 54/135 2023-11-19T00:37:23.870 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 55/135 2023-11-19T00:37:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 56/135 2023-11-19T00:37:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 57/135 2023-11-19T00:37:24.101 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 58/135 2023-11-19T00:37:24.136 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 59/135 2023-11-19T00:37:24.168 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 60/135 2023-11-19T00:37:24.198 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 61/135 2023-11-19T00:37:24.226 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 62/135 2023-11-19T00:37:24.236 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:24.269 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:24.270 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/135 2023-11-19T00:37:24.306 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/135 2023-11-19T00:37:24.335 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/135 2023-11-19T00:37:24.338 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:24.338 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-19T00:37:24.338 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-19T00:37:24.339 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:24.379 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/135 2023-11-19T00:37:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/135 2023-11-19T00:37:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/135 2023-11-19T00:37:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/135 2023-11-19T00:37:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/135 2023-11-19T00:37:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/135 2023-11-19T00:37:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/135 2023-11-19T00:37:24.798 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/135 2023-11-19T00:37:24.852 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/135 2023-11-19T00:37:25.347 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:25.379 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:25.627 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/135 2023-11-19T00:37:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/135 2023-11-19T00:37:25.714 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/135 2023-11-19T00:37:25.746 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/135 2023-11-19T00:37:25.922 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:25.931 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/135 2023-11-19T00:37:25.957 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:25.961 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/135 2023-11-19T00:37:26.031 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:26.031 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-19T00:37:26.032 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-19T00:37:26.032 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:26.042 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/135 2023-11-19T00:37:26.075 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:26.744 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/135 2023-11-19T00:37:26.870 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/135 2023-11-19T00:37:28.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/135 2023-11-19T00:37:28.270 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/135 2023-11-19T00:37:28.305 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/135 2023-11-19T00:37:28.340 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-16.el9.x86_64 87/135 2023-11-19T00:37:28.369 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/135 2023-11-19T00:37:28.396 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 89/135 2023-11-19T00:37:28.704 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/135 2023-11-19T00:37:28.741 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:28.832 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 91/135 2023-11-19T00:37:28.862 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 92/135 2023-11-19T00:37:28.905 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/135 2023-11-19T00:37:29.358 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 94/135 2023-11-19T00:37:29.385 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 95/135 2023-11-19T00:37:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 96/135 2023-11-19T00:37:31.704 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:31.742 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:32.314 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/135 2023-11-19T00:37:32.345 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:32.432 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/135 2023-11-19T00:37:32.432 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-19T00:37:32.433 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-19T00:37:32.433 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:32.463 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2023-11-19T00:37:33.953 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2023-11-19T00:37:33.954 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:34.121 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:34.137 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:34.137 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:34.137 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-19T00:37:34.137 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:35.707 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:35.733 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:35.733 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:35.733 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-19T00:37:35.733 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:35.734 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:35.734 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:35.905 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:35.905 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2023-11-19T00:37:35.905 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2023-11-19T00:37:35.905 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2023-11-19T00:37:35.906 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2023-11-19T00:37:35.906 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2023-11-19T00:37:35.906 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2023-11-19T00:37:35.906 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2023-11-19T00:37:35.906 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:35.933 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:35.954 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:35.955 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:35.955 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-19T00:37:35.955 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:35.955 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:35.955 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:36.070 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:36.087 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:36.087 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:36.087 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-19T00:37:36.087 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:36.408 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:36.431 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-19T00:37:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:36.431 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:36.431 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 104/135 2023-11-19T00:37:36.924 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:36.941 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:36.970 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 106/135 2023-11-19T00:37:37.023 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 107/135 2023-11-19T00:37:37.048 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:37.267 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:37.299 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:37.690 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:37.716 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:37.716 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:37.716 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-19T00:37:37.716 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:37.716 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:37.716 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:37.723 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:37.723 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2023-11-19T00:37:37.723 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2023-11-19T00:37:37.724 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2023-11-19T00:37:37.724 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2023-11-19T00:37:37.724 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2023-11-19T00:37:37.724 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2023-11-19T00:37:37.724 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2023-11-19T00:37:37.724 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:37.877 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:37.892 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:37.892 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:37.892 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-19T00:37:37.892 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:37.915 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:37.938 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:37.938 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:37.938 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-19T00:37:37.938 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:37.938 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:37.938 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:38.291 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:38.383 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:38.389 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:38.405 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:38.405 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:38.405 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-19T00:37:38.406 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:38.406 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:38.406 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 104/135 2023-11-19T00:37:38.539 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 111/135 2023-11-19T00:37:38.577 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:38.600 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:38.600 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:38.600 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-19T00:37:38.600 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:38.600 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:38.600 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:38.644 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:38.654 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:38.708 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 114/135 2023-11-19T00:37:38.957 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:38.974 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:38.994 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 106/135 2023-11-19T00:37:39.048 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 107/135 2023-11-19T00:37:39.072 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:39.323 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:39.488 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-45.el9.x86_64 115/135 2023-11-19T00:37:39.496 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:39.496 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:39.496 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-19T00:37:39.496 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:39.497 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:39.497 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:39.521 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:39.544 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:39.544 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:39.544 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-19T00:37:39.544 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:39.544 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:39.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:39.588 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:39.610 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:39.611 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:39.611 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-19T00:37:39.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:39.706 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:39.728 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:39.728 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:39.728 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-19T00:37:39.729 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:39.729 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:39.729 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:39.914 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:39.936 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:39.936 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:39.936 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-19T00:37:39.936 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:39.936 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:39.937 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:40.173 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:40.196 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:40.196 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:40.196 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-19T00:37:40.196 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:40.196 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:40.197 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:40.283 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 104/135 2023-11-19T00:37:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:40.555 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 111/135 2023-11-19T00:37:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:40.615 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:40.615 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-19T00:37:40.615 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:40.615 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:40.697 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:40.717 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 114/135 2023-11-19T00:37:40.723 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 106/135 2023-11-19T00:37:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 107/135 2023-11-19T00:37:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:41.057 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:41.495 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-45.el9.x86_64 115/135 2023-11-19T00:37:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:41.550 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:41.550 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:41.550 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-19T00:37:41.550 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:41.550 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:41.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:41.595 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:41.617 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:41.617 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-19T00:37:41.617 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:41.912 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:41.935 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:41.935 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:41.935 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-19T00:37:41.935 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:41.936 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:41.936 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:42.045 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:42.074 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 111/135 2023-11-19T00:37:42.366 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:42.390 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:42.390 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:42.390 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-19T00:37:42.390 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:42.390 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:42.390 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:42.434 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:42.444 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:42.500 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 114/135 2023-11-19T00:37:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-45.el9.x86_64 115/135 2023-11-19T00:37:43.311 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:43.334 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:43.334 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:43.334 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-19T00:37:43.334 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:43.334 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:43.334 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:43.378 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:43.405 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:43.405 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:43.405 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-19T00:37:43.405 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:43.695 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:43.718 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:43.718 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:43.718 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-19T00:37:43.718 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:43.718 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:43.719 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:43.762 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 119/135 2023-11-19T00:37:43.808 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/135 2023-11-19T00:37:43.849 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 121/135 2023-11-19T00:37:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 122/135 2023-11-19T00:37:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 123/135 2023-11-19T00:37:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/135 2023-11-19T00:37:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 125/135 2023-11-19T00:37:44.126 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 99/135 2023-11-19T00:37:44.126 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2023-11-19T00:37:44.127 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2023-11-19T00:37:44.127 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2023-11-19T00:37:44.127 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2023-11-19T00:37:44.127 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2023-11-19T00:37:44.127 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2023-11-19T00:37:44.127 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2023-11-19T00:37:44.127 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:44.290 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:44.306 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 100/135 2023-11-19T00:37:44.306 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:44.307 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-19T00:37:44.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 126/135 2023-11-19T00:37:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 127/135 2023-11-19T00:37:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 128/135 2023-11-19T00:37:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 129/135 2023-11-19T00:37:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 130/135 2023-11-19T00:37:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:37:45.181 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 132/135 2023-11-19T00:37:45.181 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:45.266 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:45.266 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:45.375 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:45.441 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:45.723 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 119/135 2023-11-19T00:37:45.772 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/135 2023-11-19T00:37:45.813 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 121/135 2023-11-19T00:37:45.845 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 122/135 2023-11-19T00:37:45.939 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 123/135 2023-11-19T00:37:45.952 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:45.973 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/135 2023-11-19T00:37:45.979 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/135 2023-11-19T00:37:45.979 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:45.979 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-19T00:37:45.979 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:45.979 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-19T00:37:45.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:46.005 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 125/135 2023-11-19T00:37:46.186 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:46.210 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/135 2023-11-19T00:37:46.210 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:46.210 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-19T00:37:46.210 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:46.210 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-19T00:37:46.210 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:46.695 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:46.719 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/135 2023-11-19T00:37:46.719 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:46.719 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-19T00:37:46.719 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:46.719 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-19T00:37:46.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:46.809 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 126/135 2023-11-19T00:37:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 104/135 2023-11-19T00:37:46.873 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 127/135 2023-11-19T00:37:46.923 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 128/135 2023-11-19T00:37:47.017 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 129/135 2023-11-19T00:37:47.060 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 130/135 2023-11-19T00:37:47.085 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:37:47.111 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 132/135 2023-11-19T00:37:47.111 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:47.195 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:47.195 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 105/135 2023-11-19T00:37:47.285 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 106/135 2023-11-19T00:37:47.351 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 107/135 2023-11-19T00:37:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:47.515 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 119/135 2023-11-19T00:37:47.556 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/135 2023-11-19T00:37:47.605 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 121/135 2023-11-19T00:37:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 108/135 2023-11-19T00:37:47.637 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 122/135 2023-11-19T00:37:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:47.731 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 123/135 2023-11-19T00:37:47.765 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/135 2023-11-19T00:37:47.822 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 125/135 2023-11-19T00:37:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 126/135 2023-11-19T00:37:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 109/135 2023-11-19T00:37:48.694 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:48.707 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 127/135 2023-11-19T00:37:48.756 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 128/135 2023-11-19T00:37:48.799 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 110/135 2023-11-19T00:37:48.848 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 129/135 2023-11-19T00:37:48.878 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 130/135 2023-11-19T00:37:48.903 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:37:48.929 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 132/135 2023-11-19T00:37:48.930 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:48.966 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 111/135 2023-11-19T00:37:48.996 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:48.997 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:49.013 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:49.037 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 112/135 2023-11-19T00:37:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-19T00:37:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-19T00:37:49.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:49.067 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 113/135 2023-11-19T00:37:49.136 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:49.145 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 114/135 2023-11-19T00:37:49.686 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:49.686 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/135 2023-11-19T00:37:49.686 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/135 2023-11-19T00:37:49.686 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/135 2023-11-19T00:37:49.686 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/135 2023-11-19T00:37:49.686 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 13/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 14/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 16/135 2023-11-19T00:37:49.687 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 17/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 18/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 19/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 20/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 21/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 22/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 28/135 2023-11-19T00:37:49.688 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 29/135 2023-11-19T00:37:49.697 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 30/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 31/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 32/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 33/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 34/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 35/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 36/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 40/135 2023-11-19T00:37:49.698 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-16.el9.x86_64 45/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 51/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/135 2023-11-19T00:37:49.699 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 54/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 55/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 56/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 57/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 59/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 60/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 61/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 62/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 63/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 64/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 65/135 2023-11-19T00:37:49.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 66/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 67/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 68/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 69/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 70/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 75/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 77/135 2023-11-19T00:37:49.701 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 78/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 79/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 80/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 85/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 86/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 87/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 89/135 2023-11-19T00:37:49.702 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 90/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 93/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 94/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 100/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/135 2023-11-19T00:37:49.703 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 106/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 107/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 108/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 109/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 110/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 111/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 112/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 113/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/135 2023-11-19T00:37:49.704 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 115/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 116/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 117/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 118/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 119/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 120/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 121/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 122/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 123/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-3.el9.x86_64 124/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 125/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/135 2023-11-19T00:37:49.705 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 127/135 2023-11-19T00:37:49.706 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/135 2023-11-19T00:37:49.706 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 129/135 2023-11-19T00:37:49.706 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 130/135 2023-11-19T00:37:49.706 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:37:49.706 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 132/135 2023-11-19T00:37:49.706 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 133/135 2023-11-19T00:37:49.706 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 134/135 2023-11-19T00:37:49.991 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-45.el9.x86_64 115/135 2023-11-19T00:37:50.024 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:50.048 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 116/135 2023-11-19T00:37:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-19T00:37:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-19T00:37:50.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:50.092 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:50.115 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 117/135 2023-11-19T00:37:50.115 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:50.115 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-19T00:37:50.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:50.425 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:50.449 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/135 2023-11-19T00:37:50.449 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-19T00:37:50.449 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-19T00:37:50.450 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:50.450 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-19T00:37:50.450 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:37:51.663 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:51.663 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/135 2023-11-19T00:37:51.663 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 13/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 14/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 16/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 17/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 18/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 19/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 20/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 21/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 22/135 2023-11-19T00:37:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/135 2023-11-19T00:37:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/135 2023-11-19T00:37:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/135 2023-11-19T00:37:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/135 2023-11-19T00:37:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/135 2023-11-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 28/135 2023-11-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 29/135 2023-11-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 30/135 2023-11-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 31/135 2023-11-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 32/135 2023-11-19T00:37:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 33/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 34/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 35/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 36/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 40/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/135 2023-11-19T00:37:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-16.el9.x86_64 45/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 51/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/135 2023-11-19T00:37:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 54/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 55/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 56/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 57/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 59/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 60/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 61/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 62/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 63/135 2023-11-19T00:37:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 64/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 65/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 66/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 67/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 68/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 69/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 70/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/135 2023-11-19T00:37:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 75/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 77/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 78/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 79/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 80/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/135 2023-11-19T00:37:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 85/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 86/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 87/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 89/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 90/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 93/135 2023-11-19T00:37:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 94/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 100/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/135 2023-11-19T00:37:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 106/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 107/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 108/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 109/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 110/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 111/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 112/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 113/135 2023-11-19T00:37:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 115/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 116/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 117/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 118/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 119/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 120/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 121/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 122/135 2023-11-19T00:37:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 123/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-3.el9.x86_64 124/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 125/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 127/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 129/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 130/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 132/135 2023-11-19T00:37:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 133/135 2023-11-19T00:37:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 134/135 2023-11-19T00:37:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:52.121 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2023-11-19T00:37:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-19T00:37:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-19T00:37:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-16.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-19T00:37:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-19T00:37:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-19T00:37:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-19T00:37:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-19T00:37:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-19T00:37:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-19T00:37:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-3.el9.x86_64 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-19T00:37:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-19T00:37:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-19T00:37:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:37:52.133 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-11-19T00:37:52.485 DEBUG:teuthology.parallel:result is None 2023-11-19T00:37:53.315 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:53.315 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/135 2023-11-19T00:37:53.315 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/135 2023-11-19T00:37:53.315 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 13/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 14/135 2023-11-19T00:37:53.316 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 16/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 17/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 18/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 19/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 20/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 21/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 22/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/135 2023-11-19T00:37:53.317 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 28/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 29/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 30/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 31/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 32/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 33/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 34/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 35/135 2023-11-19T00:37:53.318 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 36/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 40/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jq-1.6-16.el9.x86_64 45/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/135 2023-11-19T00:37:53.319 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 51/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 54/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 55/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 56/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 57/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 59/135 2023-11-19T00:37:53.320 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 60/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 61/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 62/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 63/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 64/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 65/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 66/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 67/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 68/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 69/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 70/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/135 2023-11-19T00:37:53.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 75/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 77/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 78/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 79/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 80/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/135 2023-11-19T00:37:53.322 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 85/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 86/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 87/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 89/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 90/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 93/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 94/135 2023-11-19T00:37:53.323 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 100/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 106/135 2023-11-19T00:37:53.324 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 107/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 108/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 109/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 110/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 111/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 112/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 113/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 115/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 116/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 117/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 118/135 2023-11-19T00:37:53.325 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 119/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 120/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 121/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 122/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 123/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-3.el9.x86_64 124/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 125/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 127/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 129/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 130/135 2023-11-19T00:37:53.326 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:37:53.327 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 132/135 2023-11-19T00:37:53.327 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 133/135 2023-11-19T00:37:53.327 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 134/135 2023-11-19T00:37:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:53.983 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2023-11-19T00:37:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-19T00:37:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-19T00:37:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-19T00:37:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.984 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-11-19T00:37:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2023-11-19T00:37:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2023-11-19T00:37:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-19T00:37:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-19T00:37:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2023-11-19T00:37:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-19T00:37:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-19T00:37:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-19T00:37:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-19T00:37:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-19T00:37:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-16.el9.x86_64 2023-11-19T00:37:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-19T00:37:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-19T00:37:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-19T00:37:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-19T00:37:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-19T00:37:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-19T00:37:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-19T00:37:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-19T00:37:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-19T00:37:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-19T00:37:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-19T00:37:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-19T00:37:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-19T00:37:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-19T00:37:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-19T00:37:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-19T00:37:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-19T00:37:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-19T00:37:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-19T00:37:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-19T00:37:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-19T00:37:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-19T00:37:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-19T00:37:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-19T00:37:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-19T00:37:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-19T00:37:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-19T00:37:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-19T00:37:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-19T00:37:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-19T00:37:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-19T00:37:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-19T00:37:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-19T00:37:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-19T00:37:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-19T00:37:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-19T00:37:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-19T00:37:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-19T00:37:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-19T00:37:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-19T00:37:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-19T00:37:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-19T00:37:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-19T00:37:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-19T00:37:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-19T00:37:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-19T00:37:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-19T00:37:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-19T00:37:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-19T00:37:53.998 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-19T00:37:53.998 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2023-11-19T00:37:53.998 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-19T00:37:53.998 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-19T00:37:53.998 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-19T00:37:53.998 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-19T00:37:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-19T00:37:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-19T00:37:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-19T00:37:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-19T00:37:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-19T00:37:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-19T00:37:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-19T00:37:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-19T00:37:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-19T00:37:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-19T00:37:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-19T00:37:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-19T00:37:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-19T00:37:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-19T00:37:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-19T00:37:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-19T00:37:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-19T00:37:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-3.el9.x86_64 2023-11-19T00:37:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-19T00:37:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-19T00:37:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-19T00:37:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-19T00:37:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-19T00:37:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:37:54.004 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-11-19T00:37:54.388 DEBUG:teuthology.parallel:result is None 2023-11-19T00:37:54.504 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 119/135 2023-11-19T00:37:54.545 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/135 2023-11-19T00:37:54.586 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 121/135 2023-11-19T00:37:54.626 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 122/135 2023-11-19T00:37:54.725 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 123/135 2023-11-19T00:37:54.753 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/135 2023-11-19T00:37:54.786 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 125/135 2023-11-19T00:37:55.695 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 126/135 2023-11-19T00:37:55.741 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 135/135 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2023-11-19T00:37:55.742 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.743 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-19T00:37:55.744 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: jq-1.6-16.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-19T00:37:55.745 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-19T00:37:55.746 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-19T00:37:55.747 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-19T00:37:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-19T00:37:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-19T00:37:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-19T00:37:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-3.el9.x86_64 2023-11-19T00:37:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-19T00:37:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-19T00:37:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-19T00:37:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-19T00:37:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-19T00:37:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:37:55.753 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2023-11-19T00:37:55.763 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 127/135 2023-11-19T00:37:55.806 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 128/135 2023-11-19T00:37:55.913 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 129/135 2023-11-19T00:37:55.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 130/135 2023-11-19T00:37:55.967 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:37:55.993 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 132/135 2023-11-19T00:37:55.993 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:56.061 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 133/135 2023-11-19T00:37:56.061 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:56.131 DEBUG:teuthology.parallel:result is None 2023-11-19T00:37:56.145 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 134/135 2023-11-19T00:37:56.212 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:38:00.367 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 135/135 2023-11-19T00:38:00.367 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/135 2023-11-19T00:38:00.367 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/135 2023-11-19T00:38:00.367 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 13/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 14/135 2023-11-19T00:38:00.368 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 16/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 17/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 18/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 19/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 20/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 21/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 22/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/135 2023-11-19T00:38:00.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 28/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 29/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 30/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 31/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 32/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 33/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 34/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 35/135 2023-11-19T00:38:00.370 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 36/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 40/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-16.el9.x86_64 45/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/135 2023-11-19T00:38:00.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 51/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 54/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 55/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 56/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 57/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 59/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 60/135 2023-11-19T00:38:00.372 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 61/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 62/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 63/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 64/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 65/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 66/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 67/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 68/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 69/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 70/135 2023-11-19T00:38:00.373 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 75/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 77/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 78/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 79/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 80/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/135 2023-11-19T00:38:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 85/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 86/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 87/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 89/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 90/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 93/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 94/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/135 2023-11-19T00:38:00.375 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 100/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 106/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 107/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 108/135 2023-11-19T00:38:00.376 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 109/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 110/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 111/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 112/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 113/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 115/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 116/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 117/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 118/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 119/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 120/135 2023-11-19T00:38:00.377 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 121/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 122/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 123/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 124/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 125/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 127/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 129/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 130/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 131/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 132/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 133/135 2023-11-19T00:38:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 134/135 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 135/135 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2023-11-19T00:38:02.961 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.962 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-19T00:38:02.963 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-16.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.964 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-19T00:38:02.965 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.966 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-19T00:38:02.967 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-19T00:38:02.968 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.969 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-19T00:38:02.970 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-19T00:38:02.971 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-19T00:38:02.972 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-19T00:38:02.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:02.972 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-11-19T00:38:03.317 DEBUG:teuthology.parallel:result is None 2023-11-19T00:38:03.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:38:03.458 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-19T00:38:03.480 INFO:teuthology.orchestra.run.smithi046.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:03.481 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:03.481 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-19T00:38:03.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:38:03.617 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-19T00:38:03.643 INFO:teuthology.orchestra.run.smithi073.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:03.643 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:03.643 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-19T00:38:03.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:38:03.872 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-19T00:38:03.899 INFO:teuthology.orchestra.run.smithi099.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:03.899 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:03.899 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-19T00:38:03.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:38:04.040 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-19T00:38:04.066 INFO:teuthology.orchestra.run.smithi181.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:04.066 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-19T00:38:04.067 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-19T00:38:04.067 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-19T00:38:04.067 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:04.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-19T00:38:04.105 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:04.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-19T00:38:04.140 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:04.141 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-19T00:38:04.176 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:04.177 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-19T00:38:04.210 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-19T00:38:04.210 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:04.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2023-11-19T00:38:04.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-19T00:38:04.319 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:04.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-11-19T00:38:04.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-19T00:38:04.422 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:04.423 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2023-11-19T00:38:04.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-19T00:38:04.524 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:04.525 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2023-11-19T00:38:04.556 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-19T00:38:04.627 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-19T00:38:04.628 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:04.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-19T00:38:04.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-19T00:38:04.738 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:04.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-19T00:38:04.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-19T00:38:04.841 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:04.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-19T00:38:04.873 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-19T00:38:04.943 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:04.945 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-19T00:38:04.977 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-19T00:38:05.047 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-19T00:38:05.047 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:05.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2023-11-19T00:38:05.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-19T00:38:05.158 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:05.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-11-19T00:38:05.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-19T00:38:05.260 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:05.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2023-11-19T00:38:05.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-19T00:38:05.363 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:05.363 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2023-11-19T00:38:05.394 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-19T00:38:05.465 INFO:teuthology.run_tasks:Running task ceph... 2023-11-19T00:38:05.530 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-19T00:38:05.531 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2023-11-19T00:38:05.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-11-19T00:38:05.536 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2023-11-19T00:38:05.538 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2023-11-19T00:38:05.567 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-19T00:38:05.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-19T00:38:05.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-19T00:38:05.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-19T00:38:05.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-19T00:38:05.643 INFO:tasks.ceph:Creating extra log directories... 2023-11-19T00:38:05.643 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-19T00:38:05.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-19T00:38:05.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-19T00:38:05.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-19T00:38:05.731 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-19T00:38:05.731 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-19T00:38:05.731 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7461827', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 9543, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQBHS/YCkprHvrURc0T4/2aDuLdCy8qUyqDYAc7KrJleX5+zwSGWZFSBH1IKD+3+HsJLWXsbri5WgOTRUvbtjw=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlPHOv6p5VaKvmRzZSAowT6fF1TAUztcdWUe8Re0wnn0ED6wT9Ew5Og+Fvnc34P6v0mIISXY8eiDsXaoMhhoHQ=', 'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyNra49sqNfE5JtecpgVnnD0W7aNE2VivweYAVTC02O/J6A1juzldgIkYHaS7Aa4syjYVS55LVXI4yDiN8JMB0=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0LdHkJ32dDApuGXu3KyH+/tCuOfSVpKJ7fnTRROW7N40indaSRMfXoBxvzOI+X/s+Ld8vzHPaesXljpAu5kek='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsx.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-18_13:54:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-19T00:38:05.732 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-19T00:38:05.756 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-19T00:38:05.758 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-19T00:38:05.760 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-19T00:38:05.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2023-11-19T00:38:05.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-11-19T00:38:05.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2023-11-19T00:38:05.818 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2023-11-19T00:38:05.846 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:05.847 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-11-19T00:38:05.902 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-19T00:38:05.903 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-11-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-19T00:38:05.960 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-19 00:37:45.773743471 +0000 2023-11-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-19 00:35:41.829197786 +0000 2023-11-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-19 00:35:41.829197786 +0000 2023-11-19T00:38:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-11-19 00:35:41.829197786 +0000 2023-11-19T00:38:05.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-19T00:38:06.028 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-19T00:38:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-19T00:38:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.00021342 s, 2.4 MB/s 2023-11-19T00:38:06.030 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-19T00:38:06.087 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-11-19T00:38:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-19T00:38:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-11-19T00:38:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-19 00:37:45.773743471 +0000 2023-11-19T00:38:06.144 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-19 00:35:42.318186169 +0000 2023-11-19T00:38:06.145 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-19 00:35:42.318186169 +0000 2023-11-19T00:38:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-11-19 00:35:42.318186169 +0000 2023-11-19T00:38:06.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-19T00:38:06.212 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-19T00:38:06.212 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-19T00:38:06.212 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000182181 s, 2.8 MB/s 2023-11-19T00:38:06.213 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-19T00:38:06.270 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-19 00:37:45.774743448 +0000 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-19 00:35:42.808174527 +0000 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-19 00:35:42.808174527 +0000 2023-11-19T00:38:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-11-19 00:35:42.808174527 +0000 2023-11-19T00:38:06.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-19T00:38:06.394 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-19T00:38:06.394 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-19T00:38:06.394 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000233573 s, 2.2 MB/s 2023-11-19T00:38:06.395 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-19T00:38:06.452 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-11-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:06.508 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-19 00:37:45.774743448 +0000 2023-11-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-19 00:35:43.278163361 +0000 2023-11-19T00:38:06.509 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-19 00:35:43.278163361 +0000 2023-11-19T00:38:06.510 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-11-19 00:35:43.278163361 +0000 2023-11-19T00:38:06.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-19T00:38:06.573 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-19T00:38:06.573 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-19T00:38:06.573 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000233134 s, 2.2 MB/s 2023-11-19T00:38:06.574 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-19T00:38:06.630 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-11-19T00:38:06.631 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:06.631 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2023-11-19T00:38:06.648 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-19T00:38:06.648 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2023-11-19T00:38:06.704 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-19T00:38:06.704 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:06.704 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-19T00:38:06.705 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:06.705 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:06.705 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-11-19 00:37:47.681657860 +0000 2023-11-19T00:38:06.705 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-11-19 00:35:42.587060173 +0000 2023-11-19T00:38:06.705 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-11-19 00:35:42.587060173 +0000 2023-11-19T00:38:06.706 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-11-19 00:35:42.587060173 +0000 2023-11-19T00:38:06.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-19T00:38:06.772 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-11-19T00:38:06.773 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-11-19T00:38:06.773 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000228163 s, 2.2 MB/s 2023-11-19T00:38:06.774 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-19T00:38:06.830 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2023-11-19T00:38:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-19T00:38:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:06.886 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-19T00:38:06.887 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:06.887 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:06.887 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-11-19 00:37:47.682657836 +0000 2023-11-19T00:38:06.887 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-11-19 00:35:43.093048074 +0000 2023-11-19T00:38:06.887 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-11-19 00:35:43.093048074 +0000 2023-11-19T00:38:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-11-19 00:35:43.093048074 +0000 2023-11-19T00:38:06.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-19T00:38:06.953 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-11-19T00:38:06.953 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-11-19T00:38:06.953 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000241053 s, 2.1 MB/s 2023-11-19T00:38:06.954 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-19T00:38:07.011 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2023-11-19T00:38:07.066 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-19T00:38:07.066 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:07.066 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-19T00:38:07.066 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:07.066 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:07.066 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-11-19 00:37:47.682657836 +0000 2023-11-19T00:38:07.066 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-11-19 00:35:43.588036237 +0000 2023-11-19T00:38:07.067 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-11-19 00:35:43.588036237 +0000 2023-11-19T00:38:07.067 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-11-19 00:35:43.588036237 +0000 2023-11-19T00:38:07.068 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-19T00:38:07.131 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-11-19T00:38:07.132 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-11-19T00:38:07.132 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000204377 s, 2.5 MB/s 2023-11-19T00:38:07.133 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-19T00:38:07.189 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2023-11-19T00:38:07.243 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-19T00:38:07.243 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:07.243 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-19T00:38:07.243 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:07.244 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:07.244 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-11-19 00:37:47.682657836 +0000 2023-11-19T00:38:07.244 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-11-19 00:35:44.074024616 +0000 2023-11-19T00:38:07.244 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-11-19 00:35:44.074024616 +0000 2023-11-19T00:38:07.244 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-11-19 00:35:44.074024616 +0000 2023-11-19T00:38:07.244 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-19T00:38:07.309 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-11-19T00:38:07.309 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-11-19T00:38:07.309 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000223929 s, 2.3 MB/s 2023-11-19T00:38:07.310 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-19T00:38:07.366 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-11-19T00:38:07.366 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:07.366 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2023-11-19T00:38:07.382 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-19T00:38:07.382 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2023-11-19T00:38:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-19T00:38:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:07.437 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-19T00:38:07.438 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:07.438 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:07.438 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2023-11-19 00:37:49.464633034 +0000 2023-11-19T00:38:07.438 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2023-11-19 00:35:41.909261870 +0000 2023-11-19T00:38:07.438 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2023-11-19 00:35:41.909261870 +0000 2023-11-19T00:38:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2023-11-19 00:35:41.909261870 +0000 2023-11-19T00:38:07.438 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-19T00:38:07.503 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2023-11-19T00:38:07.504 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2023-11-19T00:38:07.504 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000182298 s, 2.8 MB/s 2023-11-19T00:38:07.505 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-19T00:38:07.560 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2023-11-19T00:38:07.615 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-19T00:38:07.615 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:07.615 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-11-19T00:38:07.616 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:07.616 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:07.616 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2023-11-19 00:37:49.464633034 +0000 2023-11-19T00:38:07.616 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2023-11-19 00:35:42.411251616 +0000 2023-11-19T00:38:07.616 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2023-11-19 00:35:42.411251616 +0000 2023-11-19T00:38:07.616 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2023-11-19 00:35:42.411251616 +0000 2023-11-19T00:38:07.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-19T00:38:07.682 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2023-11-19T00:38:07.682 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2023-11-19T00:38:07.682 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000217143 s, 2.4 MB/s 2023-11-19T00:38:07.683 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-19T00:38:07.739 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2023-11-19T00:38:07.793 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-19T00:38:07.793 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:07.793 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-11-19T00:38:07.793 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:07.793 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:07.793 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2023-11-19 00:37:49.465633014 +0000 2023-11-19T00:38:07.794 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2023-11-19 00:35:42.883241976 +0000 2023-11-19T00:38:07.794 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2023-11-19 00:35:42.883241976 +0000 2023-11-19T00:38:07.794 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2023-11-19 00:35:42.883241976 +0000 2023-11-19T00:38:07.794 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-19T00:38:07.859 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2023-11-19T00:38:07.859 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2023-11-19T00:38:07.859 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000215779 s, 2.4 MB/s 2023-11-19T00:38:07.860 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-19T00:38:07.916 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2023-11-19T00:38:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-19T00:38:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-19T00:38:07.972 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-19T00:38:07.972 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:38:07.972 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2023-11-19T00:38:07.972 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2023-11-19 00:37:49.465633014 +0000 2023-11-19T00:38:07.972 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2023-11-19 00:35:43.370232029 +0000 2023-11-19T00:38:07.972 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2023-11-19 00:35:43.370232029 +0000 2023-11-19T00:38:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2023-11-19 00:35:43.370232029 +0000 2023-11-19T00:38:07.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-19T00:38:08.036 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2023-11-19T00:38:08.037 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2023-11-19T00:38:08.037 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000213638 s, 2.4 MB/s 2023-11-19T00:38:08.038 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-19T00:38:08.094 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-11-19T00:38:08.094 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-11-19T00:38:08.094 INFO:tasks.ceph:Generating config... 2023-11-19T00:38:08.095 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-19T00:38:08.096 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-19T00:38:08.096 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-19T00:38:08.096 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-19T00:38:08.096 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-19T00:38:08.096 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-19T00:38:08.096 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-19T00:38:08.096 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-19T00:38:08.097 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-19T00:38:08.097 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-19T00:38:08.097 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-19T00:38:08.097 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-19T00:38:08.097 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-19T00:38:08.097 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-19T00:38:08.097 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-19T00:38:08.098 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-19T00:38:08.098 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-19T00:38:08.098 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-11-19T00:38:08.098 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-19T00:38:08.098 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-11-19T00:38:08.098 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2023-11-19T00:38:08.098 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-19T00:38:08.098 INFO:tasks.ceph:Setting up mon.a... 2023-11-19T00:38:08.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-19T00:38:08.168 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2023-11-19T00:38:08.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-19T00:38:08.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-19T00:38:08.253 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '[v2:172.21.15.46:3301,v1:172.21.15.46:6790]'), ('mon.c', '[v2:172.21.15.46:3302,v1:172.21.15.46:6791]')] 2023-11-19T00:38:08.253 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2023-11-19T00:38:08.258 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:08.259 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-19T00:38:08.308 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --addv b '[v2:172.21.15.46:3301,v1:172.21.15.46:6790]' --addv c '[v2:172.21.15.46:3302,v1:172.21.15.46:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:08.396 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:08.396 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc 2023-11-19T00:38:08.396 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = pacific 2023-11-19T00:38:08.396 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2023-11-19T00:38:08.396 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc 2023-11-19T00:38:08.396 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2023-11-19T00:38:08.396432+0000 2023-11-19T00:38:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:created 2023-11-19T00:38:08.396432+0000 2023-11-19T00:38:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 16 (pacific) 2023-11-19T00:38:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2023-11-19T00:38:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2023-11-19T00:38:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.b 2023-11-19T00:38:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.46:3302/0,v1:172.21.15.46:6791/0] mon.c 2023-11-19T00:38:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-19T00:38:08.398 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-19T00:38:08.413 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc... 2023-11-19T00:38:08.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-19T00:38:08.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-19T00:38:08.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-19T00:38:08.465 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-19T00:38:08.512 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-11-19T00:38:08.513 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-11-19T00:38:08.513 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-19T00:38:08.513 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-11-19T00:38:08.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.513 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-11-19T00:38:08.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.513 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.514 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-11-19T00:38:08.515 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.516 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-11-19T00:38:08.517 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-11-19T00:38:08.518 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-11-19T00:38:08.519 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-11-19T00:38:08.520 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: osd memory target = 1610612736 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-11-19T00:38:08.521 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-11-19T00:38:08.522 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.522 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.522 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-11-19T00:38:08.522 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.522 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-11-19T00:38:08.523 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-19T00:38:08.523 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-11-19T00:38:08.523 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-11-19T00:38:08.523 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-11-19T00:38:08.523 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-11-19T00:38:08.523 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-11-19T00:38:08.524 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.524 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-11-19T00:38:08.524 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-11-19T00:38:08.524 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.524 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.525 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-19T00:38:08.526 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-11-19T00:38:08.527 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-11-19T00:38:08.527 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-11-19T00:38:08.527 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-11-19T00:38:08.528 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2023-11-19T00:38:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2023-11-19T00:38:08.528 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-19T00:38:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2023-11-19T00:38:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2023-11-19T00:38:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2023-11-19T00:38:08.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2023-11-19T00:38:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2023-11-19T00:38:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2023-11-19T00:38:08.530 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2023-11-19T00:38:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-19T00:38:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2023-11-19T00:38:08.531 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2023-11-19T00:38:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-19T00:38:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2023-11-19T00:38:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.532 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-19T00:38:08.533 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2023-11-19T00:38:08.534 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2023-11-19T00:38:08.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2023-11-19T00:38:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2023-11-19T00:38:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2023-11-19T00:38:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2023-11-19T00:38:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2023-11-19T00:38:08.536 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2023-11-19T00:38:08.537 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2023-11-19T00:38:08.538 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: osd blocked scrub grace period = 3600 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: osd max markdown count = 1000 2023-11-19T00:38:08.539 INFO:teuthology.orchestra.run.smithi099.stdout: osd memory target = 1610612736 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2023-11-19T00:38:08.540 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2023-11-19T00:38:08.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2023-11-19T00:38:08.542 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-19T00:38:08.543 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2023-11-19T00:38:08.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-19T00:38:08.545 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2023-11-19T00:38:08.546 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.547 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2023-11-19T00:38:08.548 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2023-11-19T00:38:08.549 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2023-11-19T00:38:08.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-11-19T00:38:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: osd blocked scrub grace period = 3600 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: osd max markdown count = 1000 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: osd memory target = 1610612736 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2023-11-19T00:38:08.552 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-11-19T00:38:08.553 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2023-11-19T00:38:08.555 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2023-11-19T00:38:08.556 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2023-11-19T00:38:08.557 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2023-11-19T00:38:08.557 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2023-11-19T00:38:08.558 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.559 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.560 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.561 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2023-11-19T00:38:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 1/20 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: osd blocked scrub grace period = 3600 2023-11-19T00:38:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: osd max markdown count = 1000 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: osd memory target = 1610612736 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2023-11-19T00:38:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2023-11-19T00:38:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2023-11-19T00:38:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2023-11-19T00:38:08.569 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2023-11-19T00:38:08.571 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-19T00:38:08.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-19T00:38:08.670 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-19T00:38:08.671 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:08.671 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-19T00:38:08.686 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:08.686 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-19T00:38:08.741 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2023-11-19T00:38:08.742 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:08.742 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-19T00:38:08.742 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-19T00:38:08.827 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:08.827 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:08.882 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-11-19T00:38:08.883 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:08.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-19T00:38:08.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-19T00:38:08.927 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:08.927 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:08.983 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2023-11-19T00:38:08.983 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:08.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-19T00:38:08.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-19T00:38:09.028 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:09.029 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:09.085 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2023-11-19T00:38:09.086 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:09.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-19T00:38:09.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-19T00:38:09.127 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:09.127 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:09.182 INFO:tasks.ceph:Setting up mon nodes... 2023-11-19T00:38:09.183 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-19T00:38:09.183 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-19T00:38:09.248 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-19T00:38:09.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-19T00:38:09.314 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-19T00:38:09.317 INFO:tasks.ceph:Setting up mds nodes... 2023-11-19T00:38:09.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-19T00:38:09.378 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-19T00:38:09.381 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-19T00:38:09.411 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-19T00:38:09.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-19T00:38:09.497 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-19T00:38:09.516 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-19T00:38:09.516 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-11-19T00:38:09.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-19T00:38:09.547 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-11-19T00:38:09.548 INFO:tasks.ceph:role: osd.0 2023-11-19T00:38:09.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-19T00:38:09.548 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-19T00:38:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-19T00:38:09.625 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-19T00:38:09.625 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-19T00:38:09.626 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-19T00:38:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-19T00:38:09.626 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-11-19T00:38:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-19T00:38:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-19T00:38:09.626 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-19T00:38:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-19T00:38:10.139 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-11-19T00:38:10.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-11-19T00:38:10.142 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-19T00:38:10.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-19T00:38:10.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:10.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-19T00:38:10.448+0000 7f05337fb500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-19T00:38:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-19T00:38:10.451+0000 7f05337fb500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-19T00:38:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-19T00:38:10.451+0000 7f05337fb500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-19T00:38:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-19T00:38:10.451+0000 7f05337fb500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-19T00:38:10.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-19T00:38:10.451+0000 7f05337fb500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-19T00:38:10.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-19T00:38:10.457+0000 7f05337fb500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-19T00:38:13.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-19T00:38:13.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-19T00:38:13.373 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-11-19T00:38:13.373 INFO:tasks.ceph:role: osd.1 2023-11-19T00:38:13.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2023-11-19T00:38:13.373 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-19T00:38:13.451 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-19T00:38:13.452 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-19T00:38:13.452 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-19T00:38:13.937 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-11-19T00:38:13.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-11-19T00:38:13.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-11-19T00:38:14.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-19T00:38:14.139 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:14.240 INFO:teuthology.orchestra.run.smithi099.stderr:2023-11-19T00:38:14.239+0000 7fa6b3b6c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-19T00:38:14.244 INFO:teuthology.orchestra.run.smithi099.stderr:2023-11-19T00:38:14.244+0000 7fa6b3b6c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-19T00:38:14.244 INFO:teuthology.orchestra.run.smithi099.stderr:2023-11-19T00:38:14.244+0000 7fa6b3b6c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-19T00:38:14.244 INFO:teuthology.orchestra.run.smithi099.stderr:2023-11-19T00:38:14.244+0000 7fa6b3b6c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-19T00:38:14.244 INFO:teuthology.orchestra.run.smithi099.stderr:2023-11-19T00:38:14.244+0000 7fa6b3b6c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-19T00:38:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2023-11-19T00:38:14.251+0000 7fa6b3b6c500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-19T00:38:17.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-19T00:38:17.132 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-19T00:38:17.164 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-11-19T00:38:17.165 INFO:tasks.ceph:role: osd.2 2023-11-19T00:38:17.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2023-11-19T00:38:17.165 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-19T00:38:17.242 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-19T00:38:17.243 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-19T00:38:17.243 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-19T00:38:17.243 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-19T00:38:17.243 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-19T00:38:17.243 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2023-11-19T00:38:17.244 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-19T00:38:17.244 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-19T00:38:17.244 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-19T00:38:17.244 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-19T00:38:17.760 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2023-11-19T00:38:17.762 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2023-11-19T00:38:17.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-11-19T00:38:17.922 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-19T00:38:17.957 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:18.063 INFO:teuthology.orchestra.run.smithi181.stderr:2023-11-19T00:38:18.062+0000 7fe9faa8a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-19T00:38:18.066 INFO:teuthology.orchestra.run.smithi181.stderr:2023-11-19T00:38:18.065+0000 7fe9faa8a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-19T00:38:18.066 INFO:teuthology.orchestra.run.smithi181.stderr:2023-11-19T00:38:18.065+0000 7fe9faa8a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-19T00:38:18.066 INFO:teuthology.orchestra.run.smithi181.stderr:2023-11-19T00:38:18.065+0000 7fe9faa8a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-19T00:38:18.066 INFO:teuthology.orchestra.run.smithi181.stderr:2023-11-19T00:38:18.065+0000 7fe9faa8a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-19T00:38:18.070 INFO:teuthology.orchestra.run.smithi181.stderr:2023-11-19T00:38:18.069+0000 7fe9faa8a500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-19T00:38:20.935 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-19T00:38:20.967 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-19T00:38:20.968 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:20.968 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-19T00:38:21.006 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:21.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-19T00:38:21.084 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:21.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-19T00:38:21.163 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:21.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-19T00:38:21.196 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:21.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-19T00:38:21.228 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:21.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-19T00:38:21.260 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:38:21.260 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-19T00:38:21.279 INFO:tasks.ceph:Adding keys to all mons... 2023-11-19T00:38:21.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-19T00:38:21.354 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2023-11-19T00:38:21.354 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDxWFllC8zWDhAAh8HssvyG79EHZ5ylJlQDeQ== 2023-11-19T00:38:21.354 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2023-11-19T00:38:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDxWFllfdbDEhAAmJsEJsiB+uLhb19le+gztg== 2023-11-19T00:38:21.355 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-11-19T00:38:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDxWFll4euVFhAAcMKOigA8oe9feGvVPz3Qdw== 2023-11-19T00:38:21.355 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2023-11-19T00:38:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDyWFllt3vPGhAA5eLOdmwovCFqAR54S8BH6Q== 2023-11-19T00:38:21.356 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2023-11-19T00:38:21.356 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQD2WFlluZVXDhAAeMavPtAnEgI8Ifbx1+QsQQ== 2023-11-19T00:38:21.356 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2023-11-19T00:38:21.356 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQD6WFllunvJAxAAaeEmF18sR2a9jQr7/WfSNw== 2023-11-19T00:38:21.356 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2023-11-19T00:38:21.357 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDxWFlloHesHRAAHwFmjaoQv+JDyjrXKWxDBQ== 2023-11-19T00:38:21.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-19T00:38:21.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-19T00:38:21.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-19T00:38:21.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-19T00:38:21.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-19T00:38:21.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-19T00:38:21.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-19T00:38:21.810 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-19T00:38:21.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-19T00:38:21.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-19T00:38:21.942 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-19T00:38:21.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-19T00:38:22.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-19T00:38:22.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-19T00:38:22.174 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-19T00:38:22.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-19T00:38:22.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-19T00:38:22.374 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-19T00:38:22.429 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-19T00:38:22.430 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-19T00:38:22.430 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-19T00:38:22.472 INFO:tasks.ceph.mon.a:Started 2023-11-19T00:38:22.472 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-19T00:38:22.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-19T00:38:22.474 INFO:tasks.ceph.mon.b:Started 2023-11-19T00:38:22.474 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-19T00:38:22.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-19T00:38:22.477 INFO:tasks.ceph.mon.c:Started 2023-11-19T00:38:22.477 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-19T00:38:22.477 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-19T00:38:22.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-19T00:38:22.479 INFO:tasks.ceph.mgr.x:Started 2023-11-19T00:38:22.479 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-19T00:38:22.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-19T00:38:22.482 INFO:tasks.ceph.mgr.y:Started 2023-11-19T00:38:22.482 INFO:tasks.ceph:Setting crush tunables to default 2023-11-19T00:38:22.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2023-11-19T00:38:22.975 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2023-11-19T00:38:22.988 INFO:tasks.ceph:check_enable_crimson: False 2023-11-19T00:38:22.988 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-19T00:38:22.988 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-19T00:38:22.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-19T00:38:23.020 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-11-19T00:38:23.020 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-19T00:38:23.051 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2023-11-19T00:38:23.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-19T00:38:23.083 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new ecde3678-8154-4745-bf35-fa177f3451e1 0 2023-11-19T00:38:23.258 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:23.257+0000 7f4bf1232040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-19T00:38:23.259 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:23.258+0000 7f3082a12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-19T00:38:23.312 INFO:teuthology.orchestra.run.smithi181.stdout:0 2023-11-19T00:38:23.313 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:23.313+0000 7f3082a12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-19T00:38:23.314 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:23.313+0000 7f4bf1232040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-19T00:38:23.322 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6 1 2023-11-19T00:38:23.499 INFO:teuthology.orchestra.run.smithi181.stdout:1 2023-11-19T00:38:23.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 8c9f9502-5eda-4cac-9485-b0ac8ea158dd 2 2023-11-19T00:38:23.686 INFO:teuthology.orchestra.run.smithi181.stdout:2 2023-11-19T00:38:23.698 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-19T00:38:23.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-19T00:38:23.700 INFO:tasks.ceph.osd.0:Started 2023-11-19T00:38:23.701 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-19T00:38:23.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-19T00:38:23.703 INFO:tasks.ceph.osd.1:Started 2023-11-19T00:38:23.703 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-19T00:38:23.704 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-19T00:38:23.705 INFO:tasks.ceph.osd.2:Started 2023-11-19T00:38:23.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:23.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:23.887 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:23.684697+0000","last_up_change":"0.000000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:23.896 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:23.895+0000 7f3082a12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-19T00:38:23.896 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:23.895+0000 7f4bf1232040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-19T00:38:23.898 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-19T00:38:23.899 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-19T00:38:23.952 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:23.951+0000 7f3082a12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-19T00:38:23.952 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:23.951+0000 7f4bf1232040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-19T00:38:23.999 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:23.998+0000 7f3082a12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-19T00:38:23.999 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:23.998+0000 7f4bf1232040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-19T00:38:24.056 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.055+0000 7f4bf1232040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-19T00:38:24.056 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.055+0000 7f3082a12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-19T00:38:24.100 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.100+0000 7f3082a12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-19T00:38:24.101 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.100+0000 7f4bf1232040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-19T00:38:24.201 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:24.207 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.206+0000 7f4bf1232040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-19T00:38:24.207 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.206+0000 7f3082a12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-19T00:38:24.283 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.282+0000 7f3082a12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-19T00:38:24.284 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.283+0000 7f4bf1232040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-19T00:38:24.295 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:38:24.293+0000 7f023da0e500 -1 Falling back to public interface 2023-11-19T00:38:24.296 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:38:24.295+0000 7fd0588da500 -1 Falling back to public interface 2023-11-19T00:38:24.304 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:38:24.303+0000 7f731318b500 -1 Falling back to public interface 2023-11-19T00:38:24.333 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.333+0000 7f3082a12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-19T00:38:24.334 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.333+0000 7f4bf1232040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-19T00:38:24.365 INFO:teuthology.misc.health.smithi046.stdout: 2023-11-19T00:38:24.365 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":5,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:23.684697+0000","last_up_change":"0.000000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:24.375 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-11-19T00:38:24.390 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.389+0000 7f4bf1232040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-19T00:38:24.390 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.389+0000 7f3082a12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-19T00:38:24.440 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.439+0000 7f4bf1232040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-19T00:38:24.440 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.439+0000 7f3082a12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-19T00:38:24.848 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.847+0000 7f4bf1232040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-19T00:38:24.848 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.847+0000 7f3082a12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-19T00:38:24.990 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:24.990+0000 7f4bf1232040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-19T00:38:24.991 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:24.990+0000 7f3082a12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-19T00:38:25.113 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:25.112+0000 7f4bf1232040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-19T00:38:25.113 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:25.112+0000 7f3082a12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-19T00:38:25.161 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:25.160+0000 7f4bf1232040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-19T00:38:25.161 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:25.160+0000 7f3082a12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-19T00:38:25.264 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:25.263+0000 7f4bf1232040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-19T00:38:25.264 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:25.263+0000 7f3082a12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-19T00:38:25.364 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:25.364+0000 7f4bf1232040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-19T00:38:25.365 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:25.364+0000 7f3082a12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-19T00:38:25.512 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:25.511+0000 7f4bf1232040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-19T00:38:25.513 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:25.512+0000 7f3082a12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-19T00:38:25.557 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:25.556+0000 7f4bf1232040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-19T00:38:25.557 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:25.556+0000 7f3082a12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-19T00:38:25.706 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:25.705+0000 7f4bf1232040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-19T00:38:25.706 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:25.705+0000 7f3082a12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-19T00:38:26.566 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:26.564+0000 7f3082a12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-19T00:38:26.566 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:26.565+0000 7f4bf1232040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-19T00:38:26.851 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:26.850+0000 7f3082a12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-19T00:38:26.853 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:26.852+0000 7f4bf1232040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-19T00:38:26.906 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:26.905+0000 7f3082a12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-19T00:38:26.907 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:26.906+0000 7f4bf1232040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-19T00:38:27.011 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-11-19T00:38:27.010+0000 7f3082a12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-19T00:38:27.013 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:27.012+0000 7f4bf1232040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-19T00:38:27.711 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:38:27.709+0000 7f023da0e500 -1 osd.2 0 log_to_monitors true 2023-11-19T00:38:27.728 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:38:27.727+0000 7f731318b500 -1 osd.1 0 log_to_monitors true 2023-11-19T00:38:27.734 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:38:27.733+0000 7fd0588da500 -1 osd.0 0 log_to_monitors true 2023-11-19T00:38:28.028 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:28.028+0000 7f4b91e6e640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-19T00:38:28.029 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:38:28.028+0000 7f4b91e6e640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-19T00:38:30.525 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:38:30.525+0000 7f0238c6c640 -1 osd.2 0 waiting for initial osdmap 2023-11-19T00:38:30.537 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:38:30.536+0000 7f02312a5640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-19T00:38:30.594 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:38:30.593+0000 7f730e8f6640 -1 osd.1 0 waiting for initial osdmap 2023-11-19T00:38:30.604 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:38:30.604+0000 7f7306f2f640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-19T00:38:30.679 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:30.969 INFO:teuthology.misc.health.smithi046.stdout: 2023-11-19T00:38:30.969 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":7,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:29.601064+0000","last_up_change":"0.000000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:30.979 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-11-19T00:38:32.434 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:38:32.433+0000 7fd054045640 -1 osd.0 0 waiting for initial osdmap 2023-11-19T00:38:32.445 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:38:32.445+0000 7fd04c67e640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-19T00:38:37.282 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:37.566 INFO:teuthology.misc.health.smithi046.stdout: 2023-11-19T00:38:37.566 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":12,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:36.629783+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:37.577 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-11-19T00:38:37.577 INFO:tasks.ceph:Creating RBD pool 2023-11-19T00:38:37.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-19T00:38:38.741 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'rbd' created 2023-11-19T00:38:38.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-19T00:38:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-19T00:38:39.759 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-19T00:38:39.759 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-19T00:38:39.759 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-19T00:38:39.762 INFO:tasks.ceph.mds.a:Started 2023-11-19T00:38:39.762 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-19T00:38:39.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:39.846 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-11-19T00:38:40.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:39.738762+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:40.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-19T00:38:40.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-19T00:38:40.371 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-11-19T00:38:40.384 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-19T00:38:40.676 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-11-19T00:38:40.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-19T00:38:41.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:41.019 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6803/3311622644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3311622644},{"type":"v1","addr":"172.21.15.46:6803","nonce":3311622644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-19T00:38:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2023-11-19T00:38:41.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:41.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:41.325 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:40.744654+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:41.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-19T00:38:41.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-19T00:38:41.630 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-11-19T00:38:41.643 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-19T00:38:41.941 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-11-19T00:38:41.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-19T00:38:42.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:42.249 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-11-19T00:38:42.249 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 2, 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "rbd" 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:38:42.250 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-11-19T00:38:42.262 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-19T00:38:42.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-19T00:38:42.758 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-11-19T00:38:42.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-19T00:38:43.761 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-11-19T00:38:43.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-19T00:38:44.765 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 3 and data pool 4 2023-11-19T00:38:44.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:45.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:45.081 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:44.121447+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:45.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:45.387 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:45.387 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:44.121447+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:45.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-19T00:38:45.784 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-19T00:38:45.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-19T00:38:46.791 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-19T00:38:46.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-19T00:38:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:47.129 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-19T00:38:44.121737+0000","modified":"2023-11-19T00:38:46.120615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/3311622644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3311622644},{"type":"v1","addr":"172.21.15.46:6803","nonce":3311622644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-19T00:38:47.130 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2023-11-19T00:38:47.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:47.455 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:45.766733+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:47.468 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-19T00:38:47.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:38:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:47.770 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:38:47.779 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-19T00:38:47.022305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":239,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91044,"kb_used_data":1656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024476,"statfs":{"total":289910292480,"available":289817063424,"internally_reserved":0,"allocated":1695744,"data_stored":1334325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.265497"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759394+0000","last_change":"2023-11-19T00:38:42.759394+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759394+0000","last_undegraded":"2023-11-19T00:38:42.759394+0000","last_fullsized":"2023-11-19T00:38:42.759394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758437+0000","last_change":"2023-11-19T00:38:42.758437+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758437+0000","last_undegraded":"2023-11-19T00:38:42.758437+0000","last_fullsized":"2023-11-19T00:38:42.758437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758621+0000","last_change":"2023-11-19T00:38:42.758621+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758621+0000","last_undegraded":"2023-11-19T00:38:42.758621+0000","last_fullsized":"2023-11-19T00:38:42.758621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758404+0000","last_change":"2023-11-19T00:38:42.758404+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758404+0000","last_undegraded":"2023-11-19T00:38:42.758404+0000","last_fullsized":"2023-11-19T00:38:42.758404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760433+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:42.760433+0000","last_peered":"2023-11-19T00:38:42.760433+0000","last_clean":"2023-11-19T00:38:42.760433+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:42.760433+0000","last_undegraded":"2023-11-19T00:38:42.760433+0000","last_fullsized":"2023-11-19T00:38:42.760433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760600+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:42.760600+0000","last_peered":"2023-11-19T00:38:42.760600+0000","last_clean":"2023-11-19T00:38:42.760600+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:42.760600+0000","last_undegraded":"2023-11-19T00:38:42.760600+0000","last_fullsized":"2023-11-19T00:38:42.760600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758442+0000","last_change":"2023-11-19T00:38:42.758442+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758442+0000","last_undegraded":"2023-11-19T00:38:42.758442+0000","last_fullsized":"2023-11-19T00:38:42.758442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758661+0000","last_change":"2023-11-19T00:38:42.758661+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758661+0000","last_undegraded":"2023-11-19T00:38:42.758661+0000","last_fullsized":"2023-11-19T00:38:42.758661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760756+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:42.760756+0000","last_peered":"2023-11-19T00:38:42.760756+0000","last_clean":"2023-11-19T00:38:42.760756+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:42.760756+0000","last_undegraded":"2023-11-19T00:38:42.760756+0000","last_fullsized":"2023-11-19T00:38:42.760756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758443+0000","last_change":"2023-11-19T00:38:42.758443+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758443+0000","last_undegraded":"2023-11-19T00:38:42.758443+0000","last_fullsized":"2023-11-19T00:38:42.758443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759396+0000","last_change":"2023-11-19T00:38:42.759396+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759396+0000","last_undegraded":"2023-11-19T00:38:42.759396+0000","last_fullsized":"2023-11-19T00:38:42.759396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758418+0000","last_change":"2023-11-19T00:38:42.758418+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758418+0000","last_undegraded":"2023-11-19T00:38:42.758418+0000","last_fullsized":"2023-11-19T00:38:42.758418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759394+0000","last_change":"2023-11-19T00:38:42.759394+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759394+0000","last_undegraded":"2023-11-19T00:38:42.759394+0000","last_fullsized":"2023-11-19T00:38:42.759394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759369+0000","last_change":"2023-11-19T00:38:42.759369+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759369+0000","last_undegraded":"2023-11-19T00:38:42.759369+0000","last_fullsized":"2023-11-19T00:38:42.759369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.760079+0000","last_change":"2023-11-19T00:38:42.760079+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.760079+0000","last_undegraded":"2023-11-19T00:38:42.760079+0000","last_fullsized":"2023-11-19T00:38:42.760079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":645604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:38:47.784 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:38:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:38:48.131 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-19T00:38:47.022305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":239,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91044,"kb_used_data":1656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024476,"statfs":{"total":289910292480,"available":289817063424,"internally_reserved":0,"allocated":1695744,"data_stored":1334325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.265497"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759394+0000","last_change":"2023-11-19T00:38:42.759394+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759394+0000","last_undegraded":"2023-11-19T00:38:42.759394+0000","last_fullsized":"2023-11-19T00:38:42.759394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758437+0000","last_change":"2023-11-19T00:38:42.758437+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758437+0000","last_undegraded":"2023-11-19T00:38:42.758437+0000","last_fullsized":"2023-11-19T00:38:42.758437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758621+0000","last_change":"2023-11-19T00:38:42.758621+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758621+0000","last_undegraded":"2023-11-19T00:38:42.758621+0000","last_fullsized":"2023-11-19T00:38:42.758621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758404+0000","last_change":"2023-11-19T00:38:42.758404+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758404+0000","last_undegraded":"2023-11-19T00:38:42.758404+0000","last_fullsized":"2023-11-19T00:38:42.758404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760433+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:42.760433+0000","last_peered":"2023-11-19T00:38:42.760433+0000","last_clean":"2023-11-19T00:38:42.760433+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:42.760433+0000","last_undegraded":"2023-11-19T00:38:42.760433+0000","last_fullsized":"2023-11-19T00:38:42.760433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760600+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:42.760600+0000","last_peered":"2023-11-19T00:38:42.760600+0000","last_clean":"2023-11-19T00:38:42.760600+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:42.760600+0000","last_undegraded":"2023-11-19T00:38:42.760600+0000","last_fullsized":"2023-11-19T00:38:42.760600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758442+0000","last_change":"2023-11-19T00:38:42.758442+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758442+0000","last_undegraded":"2023-11-19T00:38:42.758442+0000","last_fullsized":"2023-11-19T00:38:42.758442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758661+0000","last_change":"2023-11-19T00:38:42.758661+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758661+0000","last_undegraded":"2023-11-19T00:38:42.758661+0000","last_fullsized":"2023-11-19T00:38:42.758661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760756+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:42.760756+0000","last_peered":"2023-11-19T00:38:42.760756+0000","last_clean":"2023-11-19T00:38:42.760756+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:42.760756+0000","last_undegraded":"2023-11-19T00:38:42.760756+0000","last_fullsized":"2023-11-19T00:38:42.760756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758443+0000","last_change":"2023-11-19T00:38:42.758443+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758443+0000","last_undegraded":"2023-11-19T00:38:42.758443+0000","last_fullsized":"2023-11-19T00:38:42.758443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759396+0000","last_change":"2023-11-19T00:38:42.759396+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759396+0000","last_undegraded":"2023-11-19T00:38:42.759396+0000","last_fullsized":"2023-11-19T00:38:42.759396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758418+0000","last_change":"2023-11-19T00:38:42.758418+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758418+0000","last_undegraded":"2023-11-19T00:38:42.758418+0000","last_fullsized":"2023-11-19T00:38:42.758418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759394+0000","last_change":"2023-11-19T00:38:42.759394+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759394+0000","last_undegraded":"2023-11-19T00:38:42.759394+0000","last_fullsized":"2023-11-19T00:38:42.759394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759369+0000","last_change":"2023-11-19T00:38:42.759369+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759369+0000","last_undegraded":"2023-11-19T00:38:42.759369+0000","last_fullsized":"2023-11-19T00:38:42.759369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.760079+0000","last_change":"2023-11-19T00:38:42.760079+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.760079+0000","last_undegraded":"2023-11-19T00:38:42.760079+0000","last_fullsized":"2023-11-19T00:38:42.760079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":645604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:38:48.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:38:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:38:48.484 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-19T00:38:47.022305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":239,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91044,"kb_used_data":1656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024476,"statfs":{"total":289910292480,"available":289817063424,"internally_reserved":0,"allocated":1695744,"data_stored":1334325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.265497"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759394+0000","last_change":"2023-11-19T00:38:42.759394+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759394+0000","last_undegraded":"2023-11-19T00:38:42.759394+0000","last_fullsized":"2023-11-19T00:38:42.759394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758437+0000","last_change":"2023-11-19T00:38:42.758437+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758437+0000","last_undegraded":"2023-11-19T00:38:42.758437+0000","last_fullsized":"2023-11-19T00:38:42.758437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758621+0000","last_change":"2023-11-19T00:38:42.758621+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758621+0000","last_undegraded":"2023-11-19T00:38:42.758621+0000","last_fullsized":"2023-11-19T00:38:42.758621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758404+0000","last_change":"2023-11-19T00:38:42.758404+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758404+0000","last_undegraded":"2023-11-19T00:38:42.758404+0000","last_fullsized":"2023-11-19T00:38:42.758404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760433+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:42.760433+0000","last_peered":"2023-11-19T00:38:42.760433+0000","last_clean":"2023-11-19T00:38:42.760433+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:42.760433+0000","last_undegraded":"2023-11-19T00:38:42.760433+0000","last_fullsized":"2023-11-19T00:38:42.760433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760600+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:42.760600+0000","last_peered":"2023-11-19T00:38:42.760600+0000","last_clean":"2023-11-19T00:38:42.760600+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:42.760600+0000","last_undegraded":"2023-11-19T00:38:42.760600+0000","last_fullsized":"2023-11-19T00:38:42.760600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758442+0000","last_change":"2023-11-19T00:38:42.758442+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758442+0000","last_undegraded":"2023-11-19T00:38:42.758442+0000","last_fullsized":"2023-11-19T00:38:42.758442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758661+0000","last_change":"2023-11-19T00:38:42.758661+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758661+0000","last_undegraded":"2023-11-19T00:38:42.758661+0000","last_fullsized":"2023-11-19T00:38:42.758661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-19T00:38:42.760756+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:42.760756+0000","last_peered":"2023-11-19T00:38:42.760756+0000","last_clean":"2023-11-19T00:38:42.760756+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:42.760756+0000","last_undegraded":"2023-11-19T00:38:42.760756+0000","last_fullsized":"2023-11-19T00:38:42.760756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758443+0000","last_change":"2023-11-19T00:38:42.758443+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758443+0000","last_undegraded":"2023-11-19T00:38:42.758443+0000","last_fullsized":"2023-11-19T00:38:42.758443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759396+0000","last_change":"2023-11-19T00:38:42.759396+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759396+0000","last_undegraded":"2023-11-19T00:38:42.759396+0000","last_fullsized":"2023-11-19T00:38:42.759396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.758418+0000","last_change":"2023-11-19T00:38:42.758418+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.758418+0000","last_undegraded":"2023-11-19T00:38:42.758418+0000","last_fullsized":"2023-11-19T00:38:42.758418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-19T00:38:43.756866+0000","last_change":"2023-11-19T00:38:43.756866+0000","last_active":"2023-11-19T00:38:43.756866+0000","last_peered":"2023-11-19T00:38:43.756866+0000","last_clean":"2023-11-19T00:38:43.756866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:43.756866+0000","last_undegraded":"2023-11-19T00:38:43.756866+0000","last_fullsized":"2023-11-19T00:38:43.756866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759394+0000","last_change":"2023-11-19T00:38:42.759394+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759394+0000","last_undegraded":"2023-11-19T00:38:42.759394+0000","last_fullsized":"2023-11-19T00:38:42.759394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.759369+0000","last_change":"2023-11-19T00:38:42.759369+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.759369+0000","last_undegraded":"2023-11-19T00:38:42.759369+0000","last_fullsized":"2023-11-19T00:38:42.759369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-19T00:38:42.760079+0000","last_change":"2023-11-19T00:38:42.760079+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:38:42.760079+0000","last_undegraded":"2023-11-19T00:38:42.760079+0000","last_fullsized":"2023-11-19T00:38:42.760079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":645604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:38:48.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-11-19T00:38:48.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.759394+0000', 'last_change': '2023-11-19T00:38:42.759394+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.759394+0000', 'last_undegraded': '2023-11-19T00:38:42.759394+0000', 'last_fullsized': '2023-11-19T00:38:42.759394+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.758437+0000', 'last_change': '2023-11-19T00:38:42.758437+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.758437+0000', 'last_undegraded': '2023-11-19T00:38:42.758437+0000', 'last_fullsized': '2023-11-19T00:38:42.758437+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.758621+0000', 'last_change': '2023-11-19T00:38:42.758621+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.758621+0000', 'last_undegraded': '2023-11-19T00:38:42.758621+0000', 'last_fullsized': '2023-11-19T00:38:42.758621+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-11-19T00:38:48.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.758404+0000', 'last_change': '2023-11-19T00:38:42.758404+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.758404+0000', 'last_undegraded': '2023-11-19T00:38:42.758404+0000', 'last_fullsized': '2023-11-19T00:38:42.758404+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.758442+0000', 'last_change': '2023-11-19T00:38:42.758442+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.758442+0000', 'last_undegraded': '2023-11-19T00:38:42.758442+0000', 'last_fullsized': '2023-11-19T00:38:42.758442+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.758661+0000', 'last_change': '2023-11-19T00:38:42.758661+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.758661+0000', 'last_undegraded': '2023-11-19T00:38:42.758661+0000', 'last_fullsized': '2023-11-19T00:38:42.758661+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-19T00:38:48.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.758443+0000', 'last_change': '2023-11-19T00:38:42.758443+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.758443+0000', 'last_undegraded': '2023-11-19T00:38:42.758443+0000', 'last_fullsized': '2023-11-19T00:38:42.758443+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.759396+0000', 'last_change': '2023-11-19T00:38:42.759396+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.759396+0000', 'last_undegraded': '2023-11-19T00:38:42.759396+0000', 'last_fullsized': '2023-11-19T00:38:42.759396+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-19T00:38:48.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.758418+0000', 'last_change': '2023-11-19T00:38:42.758418+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.758418+0000', 'last_undegraded': '2023-11-19T00:38:42.758418+0000', 'last_fullsized': '2023-11-19T00:38:42.758418+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-19T00:38:43.756866+0000', 'last_change': '2023-11-19T00:38:43.756866+0000', 'last_active': '2023-11-19T00:38:43.756866+0000', 'last_peered': '2023-11-19T00:38:43.756866+0000', 'last_clean': '2023-11-19T00:38:43.756866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:43.756866+0000', 'last_undegraded': '2023-11-19T00:38:43.756866+0000', 'last_fullsized': '2023-11-19T00:38:43.756866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:43.756866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.759394+0000', 'last_change': '2023-11-19T00:38:42.759394+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.759394+0000', 'last_undegraded': '2023-11-19T00:38:42.759394+0000', 'last_fullsized': '2023-11-19T00:38:42.759394+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.759369+0000', 'last_change': '2023-11-19T00:38:42.759369+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.759369+0000', 'last_undegraded': '2023-11-19T00:38:42.759369+0000', 'last_fullsized': '2023-11-19T00:38:42.759369+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-11-19T00:38:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-19T00:38:42.760079+0000', 'last_change': '2023-11-19T00:38:42.760079+0000', 'last_active': '2023-11-19T00:38:42.752781+0000', 'last_peered': '2023-11-19T00:38:42.752781+0000', 'last_clean': '2023-11-19T00:38:42.752781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-19T00:38:42.760079+0000', 'last_undegraded': '2023-11-19T00:38:42.760079+0000', 'last_fullsized': '2023-11-19T00:38:42.760079+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'last_clean_scrub_stamp': '2023-11-19T00:38:42.752781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-19T00:38:48.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-19T00:38:48.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:48.887 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1700354312,"num_in_osds":3,"osd_in_since":1700354303,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":75},{"state_name":"unknown","count":18},{"state_name":"creating+peering","count":12}],"num_pgs":105,"num_pools":4,"num_objects":19,"data_bytes":592196,"bytes_used":93229056,"bytes_avail":289817063424,"bytes_total":289910292480,"unknown_pgs_ratio":0.17142857611179352,"inactive_pgs_ratio":0.11428571492433548,"write_bytes_sec":3120,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4217}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-19T00:38:22.633533+0000","services":{}},"progress_events":{}} 2023-11-19T00:38:48.900 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-19T00:38:48.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:38:49.197 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:38:49.209 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-19T00:38:49.022695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91092,"kb_used_data":1696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024428,"statfs":{"total":289910292480,"available":289817014272,"internally_reserved":0,"allocated":1736704,"data_stored":1353240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001082"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772977+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:38:45.772977+0000","last_peered":"2023-11-19T00:38:45.772977+0000","last_clean":"2023-11-19T00:38:45.772977+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:38:45.772977+0000","last_undegraded":"2023-11-19T00:38:45.772977+0000","last_fullsized":"2023-11-19T00:38:45.772977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773491+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:38:45.773491+0000","last_peered":"2023-11-19T00:38:45.773491+0000","last_clean":"2023-11-19T00:38:45.773491+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:38:45.773491+0000","last_undegraded":"2023-11-19T00:38:45.773491+0000","last_fullsized":"2023-11-19T00:38:45.773491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772983+0000","last_change":"2023-11-19T00:38:44.774728+0000","last_active":"2023-11-19T00:38:45.772983+0000","last_peered":"2023-11-19T00:38:45.772983+0000","last_clean":"2023-11-19T00:38:45.772983+0000","last_became_active":"2023-11-19T00:38:44.774283+0000","last_became_peered":"2023-11-19T00:38:44.774283+0000","last_unstale":"2023-11-19T00:38:45.772983+0000","last_undegraded":"2023-11-19T00:38:45.772983+0000","last_fullsized":"2023-11-19T00:38:45.772983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772096+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:38:45.772096+0000","last_peered":"2023-11-19T00:38:45.772096+0000","last_clean":"2023-11-19T00:38:45.772096+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:38:45.772096+0000","last_undegraded":"2023-11-19T00:38:45.772096+0000","last_fullsized":"2023-11-19T00:38:45.772096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773248+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:38:45.773248+0000","last_peered":"2023-11-19T00:38:45.773248+0000","last_clean":"2023-11-19T00:38:45.773248+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:38:45.773248+0000","last_undegraded":"2023-11-19T00:38:45.773248+0000","last_fullsized":"2023-11-19T00:38:45.773248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772831+0000","last_change":"2023-11-19T00:38:44.771210+0000","last_active":"2023-11-19T00:38:45.772831+0000","last_peered":"2023-11-19T00:38:45.772831+0000","last_clean":"2023-11-19T00:38:45.772831+0000","last_became_active":"2023-11-19T00:38:44.770785+0000","last_became_peered":"2023-11-19T00:38:44.770785+0000","last_unstale":"2023-11-19T00:38:45.772831+0000","last_undegraded":"2023-11-19T00:38:45.772831+0000","last_fullsized":"2023-11-19T00:38:45.772831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772299+0000","last_change":"2023-11-19T00:38:44.771258+0000","last_active":"2023-11-19T00:38:45.772299+0000","last_peered":"2023-11-19T00:38:45.772299+0000","last_clean":"2023-11-19T00:38:45.772299+0000","last_became_active":"2023-11-19T00:38:44.770632+0000","last_became_peered":"2023-11-19T00:38:44.770632+0000","last_unstale":"2023-11-19T00:38:45.772299+0000","last_undegraded":"2023-11-19T00:38:45.772299+0000","last_fullsized":"2023-11-19T00:38:45.772299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766718+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:38:44.766718+0000","last_peered":"2023-11-19T00:38:44.766718+0000","last_clean":"2023-11-19T00:38:44.766718+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:38:44.766718+0000","last_undegraded":"2023-11-19T00:38:44.766718+0000","last_fullsized":"2023-11-19T00:38:44.766718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773432+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:38:45.773432+0000","last_peered":"2023-11-19T00:38:45.773432+0000","last_clean":"2023-11-19T00:38:45.773432+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:38:45.773432+0000","last_undegraded":"2023-11-19T00:38:45.773432+0000","last_fullsized":"2023-11-19T00:38:45.773432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773080+0000","last_change":"2023-11-19T00:38:44.773267+0000","last_active":"2023-11-19T00:38:45.773080+0000","last_peered":"2023-11-19T00:38:45.773080+0000","last_clean":"2023-11-19T00:38:45.773080+0000","last_became_active":"2023-11-19T00:38:44.772893+0000","last_became_peered":"2023-11-19T00:38:44.772893+0000","last_unstale":"2023-11-19T00:38:45.773080+0000","last_undegraded":"2023-11-19T00:38:45.773080+0000","last_fullsized":"2023-11-19T00:38:45.773080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772985+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:38:45.772985+0000","last_peered":"2023-11-19T00:38:45.772985+0000","last_clean":"2023-11-19T00:38:45.772985+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:38:45.772985+0000","last_undegraded":"2023-11-19T00:38:45.772985+0000","last_fullsized":"2023-11-19T00:38:45.772985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781284+0000","last_change":"2023-11-19T00:38:43.775268+0000","last_active":"2023-11-19T00:38:44.781284+0000","last_peered":"2023-11-19T00:38:44.781284+0000","last_clean":"2023-11-19T00:38:44.781284+0000","last_became_active":"2023-11-19T00:38:43.774979+0000","last_became_peered":"2023-11-19T00:38:43.774979+0000","last_unstale":"2023-11-19T00:38:44.781284+0000","last_undegraded":"2023-11-19T00:38:44.781284+0000","last_fullsized":"2023-11-19T00:38:44.781284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773206+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:38:45.773206+0000","last_peered":"2023-11-19T00:38:45.773206+0000","last_clean":"2023-11-19T00:38:45.773206+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:38:45.773206+0000","last_undegraded":"2023-11-19T00:38:45.773206+0000","last_fullsized":"2023-11-19T00:38:45.773206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767229+0000","last_change":"2023-11-19T00:38:43.775141+0000","last_active":"2023-11-19T00:38:44.767229+0000","last_peered":"2023-11-19T00:38:44.767229+0000","last_clean":"2023-11-19T00:38:44.767229+0000","last_became_active":"2023-11-19T00:38:43.774369+0000","last_became_peered":"2023-11-19T00:38:43.774369+0000","last_unstale":"2023-11-19T00:38:44.767229+0000","last_undegraded":"2023-11-19T00:38:44.767229+0000","last_fullsized":"2023-11-19T00:38:44.767229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769057+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:38:44.769057+0000","last_peered":"2023-11-19T00:38:44.769057+0000","last_clean":"2023-11-19T00:38:44.769057+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:38:44.769057+0000","last_undegraded":"2023-11-19T00:38:44.769057+0000","last_fullsized":"2023-11-19T00:38:44.769057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769186+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:44.769186+0000","last_peered":"2023-11-19T00:38:44.769186+0000","last_clean":"2023-11-19T00:38:44.769186+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:44.769186+0000","last_undegraded":"2023-11-19T00:38:44.769186+0000","last_fullsized":"2023-11-19T00:38:44.769186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773238+0000","last_change":"2023-11-19T00:38:44.776477+0000","last_active":"2023-11-19T00:38:45.773238+0000","last_peered":"2023-11-19T00:38:45.773238+0000","last_clean":"2023-11-19T00:38:45.773238+0000","last_became_active":"2023-11-19T00:38:44.775612+0000","last_became_peered":"2023-11-19T00:38:44.775612+0000","last_unstale":"2023-11-19T00:38:45.773238+0000","last_undegraded":"2023-11-19T00:38:45.773238+0000","last_fullsized":"2023-11-19T00:38:45.773238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773217+0000","last_change":"2023-11-19T00:38:44.774583+0000","last_active":"2023-11-19T00:38:45.773217+0000","last_peered":"2023-11-19T00:38:45.773217+0000","last_clean":"2023-11-19T00:38:45.773217+0000","last_became_active":"2023-11-19T00:38:44.773998+0000","last_became_peered":"2023-11-19T00:38:44.773998+0000","last_unstale":"2023-11-19T00:38:45.773217+0000","last_undegraded":"2023-11-19T00:38:45.773217+0000","last_fullsized":"2023-11-19T00:38:45.773217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766761+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:44.766761+0000","last_peered":"2023-11-19T00:38:44.766761+0000","last_clean":"2023-11-19T00:38:44.766761+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:44.766761+0000","last_undegraded":"2023-11-19T00:38:44.766761+0000","last_fullsized":"2023-11-19T00:38:44.766761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766700+0000","last_change":"2023-11-19T00:38:43.774563+0000","last_active":"2023-11-19T00:38:44.766700+0000","last_peered":"2023-11-19T00:38:44.766700+0000","last_clean":"2023-11-19T00:38:44.766700+0000","last_became_active":"2023-11-19T00:38:43.774185+0000","last_became_peered":"2023-11-19T00:38:43.774185+0000","last_unstale":"2023-11-19T00:38:44.766700+0000","last_undegraded":"2023-11-19T00:38:44.766700+0000","last_fullsized":"2023-11-19T00:38:44.766700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:50.184703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781059+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:38:44.781059+0000","last_peered":"2023-11-19T00:38:44.781059+0000","last_clean":"2023-11-19T00:38:44.781059+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:38:44.781059+0000","last_undegraded":"2023-11-19T00:38:44.781059+0000","last_fullsized":"2023-11-19T00:38:44.781059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768473+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:44.768473+0000","last_peered":"2023-11-19T00:38:44.768473+0000","last_clean":"2023-11-19T00:38:44.768473+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:44.768473+0000","last_undegraded":"2023-11-19T00:38:44.768473+0000","last_fullsized":"2023-11-19T00:38:44.768473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772395+0000","last_change":"2023-11-19T00:38:44.778739+0000","last_active":"2023-11-19T00:38:45.772395+0000","last_peered":"2023-11-19T00:38:45.772395+0000","last_clean":"2023-11-19T00:38:45.772395+0000","last_became_active":"2023-11-19T00:38:44.777911+0000","last_became_peered":"2023-11-19T00:38:44.777911+0000","last_unstale":"2023-11-19T00:38:45.772395+0000","last_undegraded":"2023-11-19T00:38:45.772395+0000","last_fullsized":"2023-11-19T00:38:45.772395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768466+0000","last_change":"2023-11-19T00:38:43.776164+0000","last_active":"2023-11-19T00:38:44.768466+0000","last_peered":"2023-11-19T00:38:44.768466+0000","last_clean":"2023-11-19T00:38:44.768466+0000","last_became_active":"2023-11-19T00:38:43.775677+0000","last_became_peered":"2023-11-19T00:38:43.775677+0000","last_unstale":"2023-11-19T00:38:44.768466+0000","last_undegraded":"2023-11-19T00:38:44.768466+0000","last_fullsized":"2023-11-19T00:38:44.768466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:37.708461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772347+0000","last_change":"2023-11-19T00:38:44.774432+0000","last_active":"2023-11-19T00:38:45.772347+0000","last_peered":"2023-11-19T00:38:45.772347+0000","last_clean":"2023-11-19T00:38:45.772347+0000","last_became_active":"2023-11-19T00:38:44.773918+0000","last_became_peered":"2023-11-19T00:38:44.773918+0000","last_unstale":"2023-11-19T00:38:45.772347+0000","last_undegraded":"2023-11-19T00:38:45.772347+0000","last_fullsized":"2023-11-19T00:38:45.772347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772290+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:38:45.772290+0000","last_peered":"2023-11-19T00:38:45.772290+0000","last_clean":"2023-11-19T00:38:45.772290+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:38:45.772290+0000","last_undegraded":"2023-11-19T00:38:45.772290+0000","last_fullsized":"2023-11-19T00:38:45.772290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768675+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:38:44.768675+0000","last_peered":"2023-11-19T00:38:44.768675+0000","last_clean":"2023-11-19T00:38:44.768675+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:38:44.768675+0000","last_undegraded":"2023-11-19T00:38:44.768675+0000","last_fullsized":"2023-11-19T00:38:44.768675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772387+0000","last_change":"2023-11-19T00:38:44.774931+0000","last_active":"2023-11-19T00:38:45.772387+0000","last_peered":"2023-11-19T00:38:45.772387+0000","last_clean":"2023-11-19T00:38:45.772387+0000","last_became_active":"2023-11-19T00:38:44.774619+0000","last_became_peered":"2023-11-19T00:38:44.774619+0000","last_unstale":"2023-11-19T00:38:45.772387+0000","last_undegraded":"2023-11-19T00:38:45.772387+0000","last_fullsized":"2023-11-19T00:38:45.772387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767209+0000","last_change":"2023-11-19T00:38:43.774832+0000","last_active":"2023-11-19T00:38:44.767209+0000","last_peered":"2023-11-19T00:38:44.767209+0000","last_clean":"2023-11-19T00:38:44.767209+0000","last_became_active":"2023-11-19T00:38:43.774270+0000","last_became_peered":"2023-11-19T00:38:43.774270+0000","last_unstale":"2023-11-19T00:38:44.767209+0000","last_undegraded":"2023-11-19T00:38:44.767209+0000","last_fullsized":"2023-11-19T00:38:44.767209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773169+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:38:45.773169+0000","last_peered":"2023-11-19T00:38:45.773169+0000","last_clean":"2023-11-19T00:38:45.773169+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:38:45.773169+0000","last_undegraded":"2023-11-19T00:38:45.773169+0000","last_fullsized":"2023-11-19T00:38:45.773169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768429+0000","last_change":"2023-11-19T00:38:43.768405+0000","last_active":"2023-11-19T00:38:44.768429+0000","last_peered":"2023-11-19T00:38:44.768429+0000","last_clean":"2023-11-19T00:38:44.768429+0000","last_became_active":"2023-11-19T00:38:43.768158+0000","last_became_peered":"2023-11-19T00:38:43.768158+0000","last_unstale":"2023-11-19T00:38:44.768429+0000","last_undegraded":"2023-11-19T00:38:44.768429+0000","last_fullsized":"2023-11-19T00:38:44.768429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.778563+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:38:44.778563+0000","last_peered":"2023-11-19T00:38:44.778563+0000","last_clean":"2023-11-19T00:38:44.778563+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:38:44.778563+0000","last_undegraded":"2023-11-19T00:38:44.778563+0000","last_fullsized":"2023-11-19T00:38:44.778563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.785322+0000","last_change":"2023-11-19T00:38:43.775635+0000","last_active":"2023-11-19T00:38:44.785322+0000","last_peered":"2023-11-19T00:38:44.785322+0000","last_clean":"2023-11-19T00:38:44.785322+0000","last_became_active":"2023-11-19T00:38:43.775203+0000","last_became_peered":"2023-11-19T00:38:43.775203+0000","last_unstale":"2023-11-19T00:38:44.785322+0000","last_undegraded":"2023-11-19T00:38:44.785322+0000","last_fullsized":"2023-11-19T00:38:44.785322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":645604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:38:49.867 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-11-19T00:38:49.866+0000 7f1bacedc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-19T00:38:52.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:38:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:52.534 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:38:52.544 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-19T00:38:51.023129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91092,"kb_used_data":1696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024428,"statfs":{"total":289910292480,"available":289817014272,"internally_reserved":0,"allocated":1736704,"data_stored":1353240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.261329"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772977+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:38:45.772977+0000","last_peered":"2023-11-19T00:38:45.772977+0000","last_clean":"2023-11-19T00:38:45.772977+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:38:45.772977+0000","last_undegraded":"2023-11-19T00:38:45.772977+0000","last_fullsized":"2023-11-19T00:38:45.772977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773491+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:38:45.773491+0000","last_peered":"2023-11-19T00:38:45.773491+0000","last_clean":"2023-11-19T00:38:45.773491+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:38:45.773491+0000","last_undegraded":"2023-11-19T00:38:45.773491+0000","last_fullsized":"2023-11-19T00:38:45.773491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772983+0000","last_change":"2023-11-19T00:38:44.774728+0000","last_active":"2023-11-19T00:38:45.772983+0000","last_peered":"2023-11-19T00:38:45.772983+0000","last_clean":"2023-11-19T00:38:45.772983+0000","last_became_active":"2023-11-19T00:38:44.774283+0000","last_became_peered":"2023-11-19T00:38:44.774283+0000","last_unstale":"2023-11-19T00:38:45.772983+0000","last_undegraded":"2023-11-19T00:38:45.772983+0000","last_fullsized":"2023-11-19T00:38:45.772983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772096+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:38:45.772096+0000","last_peered":"2023-11-19T00:38:45.772096+0000","last_clean":"2023-11-19T00:38:45.772096+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:38:45.772096+0000","last_undegraded":"2023-11-19T00:38:45.772096+0000","last_fullsized":"2023-11-19T00:38:45.772096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773248+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:38:45.773248+0000","last_peered":"2023-11-19T00:38:45.773248+0000","last_clean":"2023-11-19T00:38:45.773248+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:38:45.773248+0000","last_undegraded":"2023-11-19T00:38:45.773248+0000","last_fullsized":"2023-11-19T00:38:45.773248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772831+0000","last_change":"2023-11-19T00:38:44.771210+0000","last_active":"2023-11-19T00:38:45.772831+0000","last_peered":"2023-11-19T00:38:45.772831+0000","last_clean":"2023-11-19T00:38:45.772831+0000","last_became_active":"2023-11-19T00:38:44.770785+0000","last_became_peered":"2023-11-19T00:38:44.770785+0000","last_unstale":"2023-11-19T00:38:45.772831+0000","last_undegraded":"2023-11-19T00:38:45.772831+0000","last_fullsized":"2023-11-19T00:38:45.772831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772299+0000","last_change":"2023-11-19T00:38:44.771258+0000","last_active":"2023-11-19T00:38:45.772299+0000","last_peered":"2023-11-19T00:38:45.772299+0000","last_clean":"2023-11-19T00:38:45.772299+0000","last_became_active":"2023-11-19T00:38:44.770632+0000","last_became_peered":"2023-11-19T00:38:44.770632+0000","last_unstale":"2023-11-19T00:38:45.772299+0000","last_undegraded":"2023-11-19T00:38:45.772299+0000","last_fullsized":"2023-11-19T00:38:45.772299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766718+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:38:44.766718+0000","last_peered":"2023-11-19T00:38:44.766718+0000","last_clean":"2023-11-19T00:38:44.766718+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:38:44.766718+0000","last_undegraded":"2023-11-19T00:38:44.766718+0000","last_fullsized":"2023-11-19T00:38:44.766718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773432+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:38:45.773432+0000","last_peered":"2023-11-19T00:38:45.773432+0000","last_clean":"2023-11-19T00:38:45.773432+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:38:45.773432+0000","last_undegraded":"2023-11-19T00:38:45.773432+0000","last_fullsized":"2023-11-19T00:38:45.773432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773080+0000","last_change":"2023-11-19T00:38:44.773267+0000","last_active":"2023-11-19T00:38:45.773080+0000","last_peered":"2023-11-19T00:38:45.773080+0000","last_clean":"2023-11-19T00:38:45.773080+0000","last_became_active":"2023-11-19T00:38:44.772893+0000","last_became_peered":"2023-11-19T00:38:44.772893+0000","last_unstale":"2023-11-19T00:38:45.773080+0000","last_undegraded":"2023-11-19T00:38:45.773080+0000","last_fullsized":"2023-11-19T00:38:45.773080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772985+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:38:45.772985+0000","last_peered":"2023-11-19T00:38:45.772985+0000","last_clean":"2023-11-19T00:38:45.772985+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:38:45.772985+0000","last_undegraded":"2023-11-19T00:38:45.772985+0000","last_fullsized":"2023-11-19T00:38:45.772985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781284+0000","last_change":"2023-11-19T00:38:43.775268+0000","last_active":"2023-11-19T00:38:44.781284+0000","last_peered":"2023-11-19T00:38:44.781284+0000","last_clean":"2023-11-19T00:38:44.781284+0000","last_became_active":"2023-11-19T00:38:43.774979+0000","last_became_peered":"2023-11-19T00:38:43.774979+0000","last_unstale":"2023-11-19T00:38:44.781284+0000","last_undegraded":"2023-11-19T00:38:44.781284+0000","last_fullsized":"2023-11-19T00:38:44.781284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773206+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:38:45.773206+0000","last_peered":"2023-11-19T00:38:45.773206+0000","last_clean":"2023-11-19T00:38:45.773206+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:38:45.773206+0000","last_undegraded":"2023-11-19T00:38:45.773206+0000","last_fullsized":"2023-11-19T00:38:45.773206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767229+0000","last_change":"2023-11-19T00:38:43.775141+0000","last_active":"2023-11-19T00:38:44.767229+0000","last_peered":"2023-11-19T00:38:44.767229+0000","last_clean":"2023-11-19T00:38:44.767229+0000","last_became_active":"2023-11-19T00:38:43.774369+0000","last_became_peered":"2023-11-19T00:38:43.774369+0000","last_unstale":"2023-11-19T00:38:44.767229+0000","last_undegraded":"2023-11-19T00:38:44.767229+0000","last_fullsized":"2023-11-19T00:38:44.767229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769057+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:38:44.769057+0000","last_peered":"2023-11-19T00:38:44.769057+0000","last_clean":"2023-11-19T00:38:44.769057+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:38:44.769057+0000","last_undegraded":"2023-11-19T00:38:44.769057+0000","last_fullsized":"2023-11-19T00:38:44.769057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769186+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:44.769186+0000","last_peered":"2023-11-19T00:38:44.769186+0000","last_clean":"2023-11-19T00:38:44.769186+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:44.769186+0000","last_undegraded":"2023-11-19T00:38:44.769186+0000","last_fullsized":"2023-11-19T00:38:44.769186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773238+0000","last_change":"2023-11-19T00:38:44.776477+0000","last_active":"2023-11-19T00:38:45.773238+0000","last_peered":"2023-11-19T00:38:45.773238+0000","last_clean":"2023-11-19T00:38:45.773238+0000","last_became_active":"2023-11-19T00:38:44.775612+0000","last_became_peered":"2023-11-19T00:38:44.775612+0000","last_unstale":"2023-11-19T00:38:45.773238+0000","last_undegraded":"2023-11-19T00:38:45.773238+0000","last_fullsized":"2023-11-19T00:38:45.773238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773217+0000","last_change":"2023-11-19T00:38:44.774583+0000","last_active":"2023-11-19T00:38:45.773217+0000","last_peered":"2023-11-19T00:38:45.773217+0000","last_clean":"2023-11-19T00:38:45.773217+0000","last_became_active":"2023-11-19T00:38:44.773998+0000","last_became_peered":"2023-11-19T00:38:44.773998+0000","last_unstale":"2023-11-19T00:38:45.773217+0000","last_undegraded":"2023-11-19T00:38:45.773217+0000","last_fullsized":"2023-11-19T00:38:45.773217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766761+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:44.766761+0000","last_peered":"2023-11-19T00:38:44.766761+0000","last_clean":"2023-11-19T00:38:44.766761+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:44.766761+0000","last_undegraded":"2023-11-19T00:38:44.766761+0000","last_fullsized":"2023-11-19T00:38:44.766761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766700+0000","last_change":"2023-11-19T00:38:43.774563+0000","last_active":"2023-11-19T00:38:44.766700+0000","last_peered":"2023-11-19T00:38:44.766700+0000","last_clean":"2023-11-19T00:38:44.766700+0000","last_became_active":"2023-11-19T00:38:43.774185+0000","last_became_peered":"2023-11-19T00:38:43.774185+0000","last_unstale":"2023-11-19T00:38:44.766700+0000","last_undegraded":"2023-11-19T00:38:44.766700+0000","last_fullsized":"2023-11-19T00:38:44.766700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:50.184703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781059+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:38:44.781059+0000","last_peered":"2023-11-19T00:38:44.781059+0000","last_clean":"2023-11-19T00:38:44.781059+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:38:44.781059+0000","last_undegraded":"2023-11-19T00:38:44.781059+0000","last_fullsized":"2023-11-19T00:38:44.781059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768473+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:44.768473+0000","last_peered":"2023-11-19T00:38:44.768473+0000","last_clean":"2023-11-19T00:38:44.768473+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:44.768473+0000","last_undegraded":"2023-11-19T00:38:44.768473+0000","last_fullsized":"2023-11-19T00:38:44.768473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772395+0000","last_change":"2023-11-19T00:38:44.778739+0000","last_active":"2023-11-19T00:38:45.772395+0000","last_peered":"2023-11-19T00:38:45.772395+0000","last_clean":"2023-11-19T00:38:45.772395+0000","last_became_active":"2023-11-19T00:38:44.777911+0000","last_became_peered":"2023-11-19T00:38:44.777911+0000","last_unstale":"2023-11-19T00:38:45.772395+0000","last_undegraded":"2023-11-19T00:38:45.772395+0000","last_fullsized":"2023-11-19T00:38:45.772395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768466+0000","last_change":"2023-11-19T00:38:43.776164+0000","last_active":"2023-11-19T00:38:44.768466+0000","last_peered":"2023-11-19T00:38:44.768466+0000","last_clean":"2023-11-19T00:38:44.768466+0000","last_became_active":"2023-11-19T00:38:43.775677+0000","last_became_peered":"2023-11-19T00:38:43.775677+0000","last_unstale":"2023-11-19T00:38:44.768466+0000","last_undegraded":"2023-11-19T00:38:44.768466+0000","last_fullsized":"2023-11-19T00:38:44.768466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:37.708461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772347+0000","last_change":"2023-11-19T00:38:44.774432+0000","last_active":"2023-11-19T00:38:45.772347+0000","last_peered":"2023-11-19T00:38:45.772347+0000","last_clean":"2023-11-19T00:38:45.772347+0000","last_became_active":"2023-11-19T00:38:44.773918+0000","last_became_peered":"2023-11-19T00:38:44.773918+0000","last_unstale":"2023-11-19T00:38:45.772347+0000","last_undegraded":"2023-11-19T00:38:45.772347+0000","last_fullsized":"2023-11-19T00:38:45.772347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772290+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:38:45.772290+0000","last_peered":"2023-11-19T00:38:45.772290+0000","last_clean":"2023-11-19T00:38:45.772290+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:38:45.772290+0000","last_undegraded":"2023-11-19T00:38:45.772290+0000","last_fullsized":"2023-11-19T00:38:45.772290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768675+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:38:44.768675+0000","last_peered":"2023-11-19T00:38:44.768675+0000","last_clean":"2023-11-19T00:38:44.768675+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:38:44.768675+0000","last_undegraded":"2023-11-19T00:38:44.768675+0000","last_fullsized":"2023-11-19T00:38:44.768675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772387+0000","last_change":"2023-11-19T00:38:44.774931+0000","last_active":"2023-11-19T00:38:45.772387+0000","last_peered":"2023-11-19T00:38:45.772387+0000","last_clean":"2023-11-19T00:38:45.772387+0000","last_became_active":"2023-11-19T00:38:44.774619+0000","last_became_peered":"2023-11-19T00:38:44.774619+0000","last_unstale":"2023-11-19T00:38:45.772387+0000","last_undegraded":"2023-11-19T00:38:45.772387+0000","last_fullsized":"2023-11-19T00:38:45.772387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767209+0000","last_change":"2023-11-19T00:38:43.774832+0000","last_active":"2023-11-19T00:38:44.767209+0000","last_peered":"2023-11-19T00:38:44.767209+0000","last_clean":"2023-11-19T00:38:44.767209+0000","last_became_active":"2023-11-19T00:38:43.774270+0000","last_became_peered":"2023-11-19T00:38:43.774270+0000","last_unstale":"2023-11-19T00:38:44.767209+0000","last_undegraded":"2023-11-19T00:38:44.767209+0000","last_fullsized":"2023-11-19T00:38:44.767209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773169+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:38:45.773169+0000","last_peered":"2023-11-19T00:38:45.773169+0000","last_clean":"2023-11-19T00:38:45.773169+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:38:45.773169+0000","last_undegraded":"2023-11-19T00:38:45.773169+0000","last_fullsized":"2023-11-19T00:38:45.773169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768429+0000","last_change":"2023-11-19T00:38:43.768405+0000","last_active":"2023-11-19T00:38:44.768429+0000","last_peered":"2023-11-19T00:38:44.768429+0000","last_clean":"2023-11-19T00:38:44.768429+0000","last_became_active":"2023-11-19T00:38:43.768158+0000","last_became_peered":"2023-11-19T00:38:43.768158+0000","last_unstale":"2023-11-19T00:38:44.768429+0000","last_undegraded":"2023-11-19T00:38:44.768429+0000","last_fullsized":"2023-11-19T00:38:44.768429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.778563+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:38:44.778563+0000","last_peered":"2023-11-19T00:38:44.778563+0000","last_clean":"2023-11-19T00:38:44.778563+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:38:44.778563+0000","last_undegraded":"2023-11-19T00:38:44.778563+0000","last_fullsized":"2023-11-19T00:38:44.778563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.785322+0000","last_change":"2023-11-19T00:38:43.775635+0000","last_active":"2023-11-19T00:38:44.785322+0000","last_peered":"2023-11-19T00:38:44.785322+0000","last_clean":"2023-11-19T00:38:44.785322+0000","last_became_active":"2023-11-19T00:38:43.775203+0000","last_became_peered":"2023-11-19T00:38:43.775203+0000","last_unstale":"2023-11-19T00:38:44.785322+0000","last_undegraded":"2023-11-19T00:38:44.785322+0000","last_fullsized":"2023-11-19T00:38:44.785322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":645604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:38:52.548 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-19T00:38:52.548 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-19T00:38:52.548 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-19T00:38:52.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-19T00:38:52.549 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-19T00:38:52.929 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:52.940 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1871357656},{"type":"v1","addr":"172.21.15.46:6801","nonce":1871357656}]},"active_addr":"172.21.15.46:6801/1871357656","active_change":"2023-11-19T00:38:27.015036+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2347309672}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1097694524}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2950475180}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":730086374}]}]} 2023-11-19T00:38:52.944 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-19T00:38:52.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-19T00:38:52.944 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:53.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:53.239 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:45.766733+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:53.251 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-19T00:38:53.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:53.545 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:45.766733+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:53.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-19T00:38:53.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-19T00:38:53.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-19T00:38:53.708 INFO:teuthology.orchestra.run.smithi046.stdout:34359738376 2023-11-19T00:38:53.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-19T00:38:53.710 INFO:teuthology.orchestra.run.smithi046.stdout:34359738374 2023-11-19T00:38:53.710 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-19T00:38:53.711 INFO:teuthology.orchestra.run.smithi046.stdout:38654705674 2023-11-19T00:38:53.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-19T00:38:54.049 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2023-11-19T00:38:54.050 INFO:teuthology.orchestra.run.smithi046.stdout:34359738375 2023-11-19T00:38:54.056 INFO:teuthology.orchestra.run.smithi046.stdout:34359738373 2023-11-19T00:38:54.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705672 for osd.0 2023-11-19T00:38:54.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2023-11-19T00:38:54.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-11-19T00:38:55.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-19T00:38:55.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-19T00:38:55.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-19T00:38:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:34359738375 2023-11-19T00:38:55.385 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2023-11-19T00:38:55.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2023-11-19T00:38:55.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705672 for osd.0 2023-11-19T00:38:55.425 INFO:teuthology.orchestra.run.smithi046.stdout:34359738373 2023-11-19T00:38:55.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-11-19T00:38:56.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-19T00:38:56.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-19T00:38:56.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-19T00:38:56.712 INFO:teuthology.orchestra.run.smithi046.stdout:34359738376 2023-11-19T00:38:56.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.2 2023-11-19T00:38:56.725 DEBUG:teuthology.parallel:result is None 2023-11-19T00:38:56.763 INFO:teuthology.orchestra.run.smithi046.stdout:38654705674 2023-11-19T00:38:56.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.0 2023-11-19T00:38:56.777 DEBUG:teuthology.parallel:result is None 2023-11-19T00:38:56.799 INFO:teuthology.orchestra.run.smithi046.stdout:34359738374 2023-11-19T00:38:56.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2023-11-19T00:38:56.813 DEBUG:teuthology.parallel:result is None 2023-11-19T00:38:56.813 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-19T00:38:56.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:38:57.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:38:57.169 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-11-19T00:38:57.024682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91104,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024416,"statfs":{"total":289910292480,"available":289817001984,"internally_reserved":0,"allocated":1744896,"data_stored":1357843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.254527"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772977+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:38:45.772977+0000","last_peered":"2023-11-19T00:38:45.772977+0000","last_clean":"2023-11-19T00:38:45.772977+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:38:45.772977+0000","last_undegraded":"2023-11-19T00:38:45.772977+0000","last_fullsized":"2023-11-19T00:38:45.772977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773491+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:38:45.773491+0000","last_peered":"2023-11-19T00:38:45.773491+0000","last_clean":"2023-11-19T00:38:45.773491+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:38:45.773491+0000","last_undegraded":"2023-11-19T00:38:45.773491+0000","last_fullsized":"2023-11-19T00:38:45.773491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772983+0000","last_change":"2023-11-19T00:38:44.774728+0000","last_active":"2023-11-19T00:38:45.772983+0000","last_peered":"2023-11-19T00:38:45.772983+0000","last_clean":"2023-11-19T00:38:45.772983+0000","last_became_active":"2023-11-19T00:38:44.774283+0000","last_became_peered":"2023-11-19T00:38:44.774283+0000","last_unstale":"2023-11-19T00:38:45.772983+0000","last_undegraded":"2023-11-19T00:38:45.772983+0000","last_fullsized":"2023-11-19T00:38:45.772983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772096+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:38:45.772096+0000","last_peered":"2023-11-19T00:38:45.772096+0000","last_clean":"2023-11-19T00:38:45.772096+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:38:45.772096+0000","last_undegraded":"2023-11-19T00:38:45.772096+0000","last_fullsized":"2023-11-19T00:38:45.772096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773248+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:38:45.773248+0000","last_peered":"2023-11-19T00:38:45.773248+0000","last_clean":"2023-11-19T00:38:45.773248+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:38:45.773248+0000","last_undegraded":"2023-11-19T00:38:45.773248+0000","last_fullsized":"2023-11-19T00:38:45.773248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772831+0000","last_change":"2023-11-19T00:38:44.771210+0000","last_active":"2023-11-19T00:38:45.772831+0000","last_peered":"2023-11-19T00:38:45.772831+0000","last_clean":"2023-11-19T00:38:45.772831+0000","last_became_active":"2023-11-19T00:38:44.770785+0000","last_became_peered":"2023-11-19T00:38:44.770785+0000","last_unstale":"2023-11-19T00:38:45.772831+0000","last_undegraded":"2023-11-19T00:38:45.772831+0000","last_fullsized":"2023-11-19T00:38:45.772831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772299+0000","last_change":"2023-11-19T00:38:44.771258+0000","last_active":"2023-11-19T00:38:45.772299+0000","last_peered":"2023-11-19T00:38:45.772299+0000","last_clean":"2023-11-19T00:38:45.772299+0000","last_became_active":"2023-11-19T00:38:44.770632+0000","last_became_peered":"2023-11-19T00:38:44.770632+0000","last_unstale":"2023-11-19T00:38:45.772299+0000","last_undegraded":"2023-11-19T00:38:45.772299+0000","last_fullsized":"2023-11-19T00:38:45.772299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766718+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:38:44.766718+0000","last_peered":"2023-11-19T00:38:44.766718+0000","last_clean":"2023-11-19T00:38:44.766718+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:38:44.766718+0000","last_undegraded":"2023-11-19T00:38:44.766718+0000","last_fullsized":"2023-11-19T00:38:44.766718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773432+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:38:45.773432+0000","last_peered":"2023-11-19T00:38:45.773432+0000","last_clean":"2023-11-19T00:38:45.773432+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:38:45.773432+0000","last_undegraded":"2023-11-19T00:38:45.773432+0000","last_fullsized":"2023-11-19T00:38:45.773432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773080+0000","last_change":"2023-11-19T00:38:44.773267+0000","last_active":"2023-11-19T00:38:45.773080+0000","last_peered":"2023-11-19T00:38:45.773080+0000","last_clean":"2023-11-19T00:38:45.773080+0000","last_became_active":"2023-11-19T00:38:44.772893+0000","last_became_peered":"2023-11-19T00:38:44.772893+0000","last_unstale":"2023-11-19T00:38:45.773080+0000","last_undegraded":"2023-11-19T00:38:45.773080+0000","last_fullsized":"2023-11-19T00:38:45.773080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772985+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:38:45.772985+0000","last_peered":"2023-11-19T00:38:45.772985+0000","last_clean":"2023-11-19T00:38:45.772985+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:38:45.772985+0000","last_undegraded":"2023-11-19T00:38:45.772985+0000","last_fullsized":"2023-11-19T00:38:45.772985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781284+0000","last_change":"2023-11-19T00:38:43.775268+0000","last_active":"2023-11-19T00:38:44.781284+0000","last_peered":"2023-11-19T00:38:44.781284+0000","last_clean":"2023-11-19T00:38:44.781284+0000","last_became_active":"2023-11-19T00:38:43.774979+0000","last_became_peered":"2023-11-19T00:38:43.774979+0000","last_unstale":"2023-11-19T00:38:44.781284+0000","last_undegraded":"2023-11-19T00:38:44.781284+0000","last_fullsized":"2023-11-19T00:38:44.781284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773206+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:38:45.773206+0000","last_peered":"2023-11-19T00:38:45.773206+0000","last_clean":"2023-11-19T00:38:45.773206+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:38:45.773206+0000","last_undegraded":"2023-11-19T00:38:45.773206+0000","last_fullsized":"2023-11-19T00:38:45.773206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767229+0000","last_change":"2023-11-19T00:38:43.775141+0000","last_active":"2023-11-19T00:38:44.767229+0000","last_peered":"2023-11-19T00:38:44.767229+0000","last_clean":"2023-11-19T00:38:44.767229+0000","last_became_active":"2023-11-19T00:38:43.774369+0000","last_became_peered":"2023-11-19T00:38:43.774369+0000","last_unstale":"2023-11-19T00:38:44.767229+0000","last_undegraded":"2023-11-19T00:38:44.767229+0000","last_fullsized":"2023-11-19T00:38:44.767229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769057+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:38:44.769057+0000","last_peered":"2023-11-19T00:38:44.769057+0000","last_clean":"2023-11-19T00:38:44.769057+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:38:44.769057+0000","last_undegraded":"2023-11-19T00:38:44.769057+0000","last_fullsized":"2023-11-19T00:38:44.769057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769186+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:44.769186+0000","last_peered":"2023-11-19T00:38:44.769186+0000","last_clean":"2023-11-19T00:38:44.769186+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:44.769186+0000","last_undegraded":"2023-11-19T00:38:44.769186+0000","last_fullsized":"2023-11-19T00:38:44.769186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773238+0000","last_change":"2023-11-19T00:38:44.776477+0000","last_active":"2023-11-19T00:38:45.773238+0000","last_peered":"2023-11-19T00:38:45.773238+0000","last_clean":"2023-11-19T00:38:45.773238+0000","last_became_active":"2023-11-19T00:38:44.775612+0000","last_became_peered":"2023-11-19T00:38:44.775612+0000","last_unstale":"2023-11-19T00:38:45.773238+0000","last_undegraded":"2023-11-19T00:38:45.773238+0000","last_fullsized":"2023-11-19T00:38:45.773238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773217+0000","last_change":"2023-11-19T00:38:44.774583+0000","last_active":"2023-11-19T00:38:45.773217+0000","last_peered":"2023-11-19T00:38:45.773217+0000","last_clean":"2023-11-19T00:38:45.773217+0000","last_became_active":"2023-11-19T00:38:44.773998+0000","last_became_peered":"2023-11-19T00:38:44.773998+0000","last_unstale":"2023-11-19T00:38:45.773217+0000","last_undegraded":"2023-11-19T00:38:45.773217+0000","last_fullsized":"2023-11-19T00:38:45.773217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766761+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:44.766761+0000","last_peered":"2023-11-19T00:38:44.766761+0000","last_clean":"2023-11-19T00:38:44.766761+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:44.766761+0000","last_undegraded":"2023-11-19T00:38:44.766761+0000","last_fullsized":"2023-11-19T00:38:44.766761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766700+0000","last_change":"2023-11-19T00:38:43.774563+0000","last_active":"2023-11-19T00:38:44.766700+0000","last_peered":"2023-11-19T00:38:44.766700+0000","last_clean":"2023-11-19T00:38:44.766700+0000","last_became_active":"2023-11-19T00:38:43.774185+0000","last_became_peered":"2023-11-19T00:38:43.774185+0000","last_unstale":"2023-11-19T00:38:44.766700+0000","last_undegraded":"2023-11-19T00:38:44.766700+0000","last_fullsized":"2023-11-19T00:38:44.766700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:50.184703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781059+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:38:44.781059+0000","last_peered":"2023-11-19T00:38:44.781059+0000","last_clean":"2023-11-19T00:38:44.781059+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:38:44.781059+0000","last_undegraded":"2023-11-19T00:38:44.781059+0000","last_fullsized":"2023-11-19T00:38:44.781059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768473+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:44.768473+0000","last_peered":"2023-11-19T00:38:44.768473+0000","last_clean":"2023-11-19T00:38:44.768473+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:44.768473+0000","last_undegraded":"2023-11-19T00:38:44.768473+0000","last_fullsized":"2023-11-19T00:38:44.768473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772395+0000","last_change":"2023-11-19T00:38:44.778739+0000","last_active":"2023-11-19T00:38:45.772395+0000","last_peered":"2023-11-19T00:38:45.772395+0000","last_clean":"2023-11-19T00:38:45.772395+0000","last_became_active":"2023-11-19T00:38:44.777911+0000","last_became_peered":"2023-11-19T00:38:44.777911+0000","last_unstale":"2023-11-19T00:38:45.772395+0000","last_undegraded":"2023-11-19T00:38:45.772395+0000","last_fullsized":"2023-11-19T00:38:45.772395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773455+0000","last_change":"2023-11-19T00:38:43.776164+0000","last_active":"2023-11-19T00:38:45.773455+0000","last_peered":"2023-11-19T00:38:45.773455+0000","last_clean":"2023-11-19T00:38:45.773455+0000","last_became_active":"2023-11-19T00:38:43.775677+0000","last_became_peered":"2023-11-19T00:38:43.775677+0000","last_unstale":"2023-11-19T00:38:45.773455+0000","last_undegraded":"2023-11-19T00:38:45.773455+0000","last_fullsized":"2023-11-19T00:38:45.773455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:37.708461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772347+0000","last_change":"2023-11-19T00:38:44.774432+0000","last_active":"2023-11-19T00:38:45.772347+0000","last_peered":"2023-11-19T00:38:45.772347+0000","last_clean":"2023-11-19T00:38:45.772347+0000","last_became_active":"2023-11-19T00:38:44.773918+0000","last_became_peered":"2023-11-19T00:38:44.773918+0000","last_unstale":"2023-11-19T00:38:45.772347+0000","last_undegraded":"2023-11-19T00:38:45.772347+0000","last_fullsized":"2023-11-19T00:38:45.772347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772290+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:38:45.772290+0000","last_peered":"2023-11-19T00:38:45.772290+0000","last_clean":"2023-11-19T00:38:45.772290+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:38:45.772290+0000","last_undegraded":"2023-11-19T00:38:45.772290+0000","last_fullsized":"2023-11-19T00:38:45.772290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768675+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:38:44.768675+0000","last_peered":"2023-11-19T00:38:44.768675+0000","last_clean":"2023-11-19T00:38:44.768675+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:38:44.768675+0000","last_undegraded":"2023-11-19T00:38:44.768675+0000","last_fullsized":"2023-11-19T00:38:44.768675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772387+0000","last_change":"2023-11-19T00:38:44.774931+0000","last_active":"2023-11-19T00:38:45.772387+0000","last_peered":"2023-11-19T00:38:45.772387+0000","last_clean":"2023-11-19T00:38:45.772387+0000","last_became_active":"2023-11-19T00:38:44.774619+0000","last_became_peered":"2023-11-19T00:38:44.774619+0000","last_unstale":"2023-11-19T00:38:45.772387+0000","last_undegraded":"2023-11-19T00:38:45.772387+0000","last_fullsized":"2023-11-19T00:38:45.772387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767209+0000","last_change":"2023-11-19T00:38:43.774832+0000","last_active":"2023-11-19T00:38:44.767209+0000","last_peered":"2023-11-19T00:38:44.767209+0000","last_clean":"2023-11-19T00:38:44.767209+0000","last_became_active":"2023-11-19T00:38:43.774270+0000","last_became_peered":"2023-11-19T00:38:43.774270+0000","last_unstale":"2023-11-19T00:38:44.767209+0000","last_undegraded":"2023-11-19T00:38:44.767209+0000","last_fullsized":"2023-11-19T00:38:44.767209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773169+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:38:45.773169+0000","last_peered":"2023-11-19T00:38:45.773169+0000","last_clean":"2023-11-19T00:38:45.773169+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:38:45.773169+0000","last_undegraded":"2023-11-19T00:38:45.773169+0000","last_fullsized":"2023-11-19T00:38:45.773169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768429+0000","last_change":"2023-11-19T00:38:43.768405+0000","last_active":"2023-11-19T00:38:44.768429+0000","last_peered":"2023-11-19T00:38:44.768429+0000","last_clean":"2023-11-19T00:38:44.768429+0000","last_became_active":"2023-11-19T00:38:43.768158+0000","last_became_peered":"2023-11-19T00:38:43.768158+0000","last_unstale":"2023-11-19T00:38:44.768429+0000","last_undegraded":"2023-11-19T00:38:44.768429+0000","last_fullsized":"2023-11-19T00:38:44.768429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.778563+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:38:44.778563+0000","last_peered":"2023-11-19T00:38:44.778563+0000","last_clean":"2023-11-19T00:38:44.778563+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:38:44.778563+0000","last_undegraded":"2023-11-19T00:38:44.778563+0000","last_fullsized":"2023-11-19T00:38:44.778563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.785322+0000","last_change":"2023-11-19T00:38:43.775635+0000","last_active":"2023-11-19T00:38:44.785322+0000","last_peered":"2023-11-19T00:38:44.785322+0000","last_clean":"2023-11-19T00:38:44.785322+0000","last_became_active":"2023-11-19T00:38:43.775203+0000","last_became_peered":"2023-11-19T00:38:43.775203+0000","last_unstale":"2023-11-19T00:38:44.785322+0000","last_undegraded":"2023-11-19T00:38:44.785322+0000","last_fullsized":"2023-11-19T00:38:44.785322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:38:57.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:38:57.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:57.516 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:38:57.523 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-11-19T00:38:57.024682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91104,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024416,"statfs":{"total":289910292480,"available":289817001984,"internally_reserved":0,"allocated":1744896,"data_stored":1357843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.254527"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772977+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:38:45.772977+0000","last_peered":"2023-11-19T00:38:45.772977+0000","last_clean":"2023-11-19T00:38:45.772977+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:38:45.772977+0000","last_undegraded":"2023-11-19T00:38:45.772977+0000","last_fullsized":"2023-11-19T00:38:45.772977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773491+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:38:45.773491+0000","last_peered":"2023-11-19T00:38:45.773491+0000","last_clean":"2023-11-19T00:38:45.773491+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:38:45.773491+0000","last_undegraded":"2023-11-19T00:38:45.773491+0000","last_fullsized":"2023-11-19T00:38:45.773491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772983+0000","last_change":"2023-11-19T00:38:44.774728+0000","last_active":"2023-11-19T00:38:45.772983+0000","last_peered":"2023-11-19T00:38:45.772983+0000","last_clean":"2023-11-19T00:38:45.772983+0000","last_became_active":"2023-11-19T00:38:44.774283+0000","last_became_peered":"2023-11-19T00:38:44.774283+0000","last_unstale":"2023-11-19T00:38:45.772983+0000","last_undegraded":"2023-11-19T00:38:45.772983+0000","last_fullsized":"2023-11-19T00:38:45.772983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772096+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:38:45.772096+0000","last_peered":"2023-11-19T00:38:45.772096+0000","last_clean":"2023-11-19T00:38:45.772096+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:38:45.772096+0000","last_undegraded":"2023-11-19T00:38:45.772096+0000","last_fullsized":"2023-11-19T00:38:45.772096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773248+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:38:45.773248+0000","last_peered":"2023-11-19T00:38:45.773248+0000","last_clean":"2023-11-19T00:38:45.773248+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:38:45.773248+0000","last_undegraded":"2023-11-19T00:38:45.773248+0000","last_fullsized":"2023-11-19T00:38:45.773248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772831+0000","last_change":"2023-11-19T00:38:44.771210+0000","last_active":"2023-11-19T00:38:45.772831+0000","last_peered":"2023-11-19T00:38:45.772831+0000","last_clean":"2023-11-19T00:38:45.772831+0000","last_became_active":"2023-11-19T00:38:44.770785+0000","last_became_peered":"2023-11-19T00:38:44.770785+0000","last_unstale":"2023-11-19T00:38:45.772831+0000","last_undegraded":"2023-11-19T00:38:45.772831+0000","last_fullsized":"2023-11-19T00:38:45.772831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772299+0000","last_change":"2023-11-19T00:38:44.771258+0000","last_active":"2023-11-19T00:38:45.772299+0000","last_peered":"2023-11-19T00:38:45.772299+0000","last_clean":"2023-11-19T00:38:45.772299+0000","last_became_active":"2023-11-19T00:38:44.770632+0000","last_became_peered":"2023-11-19T00:38:44.770632+0000","last_unstale":"2023-11-19T00:38:45.772299+0000","last_undegraded":"2023-11-19T00:38:45.772299+0000","last_fullsized":"2023-11-19T00:38:45.772299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766718+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:38:44.766718+0000","last_peered":"2023-11-19T00:38:44.766718+0000","last_clean":"2023-11-19T00:38:44.766718+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:38:44.766718+0000","last_undegraded":"2023-11-19T00:38:44.766718+0000","last_fullsized":"2023-11-19T00:38:44.766718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773432+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:38:45.773432+0000","last_peered":"2023-11-19T00:38:45.773432+0000","last_clean":"2023-11-19T00:38:45.773432+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:38:45.773432+0000","last_undegraded":"2023-11-19T00:38:45.773432+0000","last_fullsized":"2023-11-19T00:38:45.773432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773080+0000","last_change":"2023-11-19T00:38:44.773267+0000","last_active":"2023-11-19T00:38:45.773080+0000","last_peered":"2023-11-19T00:38:45.773080+0000","last_clean":"2023-11-19T00:38:45.773080+0000","last_became_active":"2023-11-19T00:38:44.772893+0000","last_became_peered":"2023-11-19T00:38:44.772893+0000","last_unstale":"2023-11-19T00:38:45.773080+0000","last_undegraded":"2023-11-19T00:38:45.773080+0000","last_fullsized":"2023-11-19T00:38:45.773080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772985+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:38:45.772985+0000","last_peered":"2023-11-19T00:38:45.772985+0000","last_clean":"2023-11-19T00:38:45.772985+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:38:45.772985+0000","last_undegraded":"2023-11-19T00:38:45.772985+0000","last_fullsized":"2023-11-19T00:38:45.772985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781284+0000","last_change":"2023-11-19T00:38:43.775268+0000","last_active":"2023-11-19T00:38:44.781284+0000","last_peered":"2023-11-19T00:38:44.781284+0000","last_clean":"2023-11-19T00:38:44.781284+0000","last_became_active":"2023-11-19T00:38:43.774979+0000","last_became_peered":"2023-11-19T00:38:43.774979+0000","last_unstale":"2023-11-19T00:38:44.781284+0000","last_undegraded":"2023-11-19T00:38:44.781284+0000","last_fullsized":"2023-11-19T00:38:44.781284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773206+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:38:45.773206+0000","last_peered":"2023-11-19T00:38:45.773206+0000","last_clean":"2023-11-19T00:38:45.773206+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:38:45.773206+0000","last_undegraded":"2023-11-19T00:38:45.773206+0000","last_fullsized":"2023-11-19T00:38:45.773206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767229+0000","last_change":"2023-11-19T00:38:43.775141+0000","last_active":"2023-11-19T00:38:44.767229+0000","last_peered":"2023-11-19T00:38:44.767229+0000","last_clean":"2023-11-19T00:38:44.767229+0000","last_became_active":"2023-11-19T00:38:43.774369+0000","last_became_peered":"2023-11-19T00:38:43.774369+0000","last_unstale":"2023-11-19T00:38:44.767229+0000","last_undegraded":"2023-11-19T00:38:44.767229+0000","last_fullsized":"2023-11-19T00:38:44.767229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769057+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:38:44.769057+0000","last_peered":"2023-11-19T00:38:44.769057+0000","last_clean":"2023-11-19T00:38:44.769057+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:38:44.769057+0000","last_undegraded":"2023-11-19T00:38:44.769057+0000","last_fullsized":"2023-11-19T00:38:44.769057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769186+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:44.769186+0000","last_peered":"2023-11-19T00:38:44.769186+0000","last_clean":"2023-11-19T00:38:44.769186+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:44.769186+0000","last_undegraded":"2023-11-19T00:38:44.769186+0000","last_fullsized":"2023-11-19T00:38:44.769186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773238+0000","last_change":"2023-11-19T00:38:44.776477+0000","last_active":"2023-11-19T00:38:45.773238+0000","last_peered":"2023-11-19T00:38:45.773238+0000","last_clean":"2023-11-19T00:38:45.773238+0000","last_became_active":"2023-11-19T00:38:44.775612+0000","last_became_peered":"2023-11-19T00:38:44.775612+0000","last_unstale":"2023-11-19T00:38:45.773238+0000","last_undegraded":"2023-11-19T00:38:45.773238+0000","last_fullsized":"2023-11-19T00:38:45.773238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773217+0000","last_change":"2023-11-19T00:38:44.774583+0000","last_active":"2023-11-19T00:38:45.773217+0000","last_peered":"2023-11-19T00:38:45.773217+0000","last_clean":"2023-11-19T00:38:45.773217+0000","last_became_active":"2023-11-19T00:38:44.773998+0000","last_became_peered":"2023-11-19T00:38:44.773998+0000","last_unstale":"2023-11-19T00:38:45.773217+0000","last_undegraded":"2023-11-19T00:38:45.773217+0000","last_fullsized":"2023-11-19T00:38:45.773217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766761+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:44.766761+0000","last_peered":"2023-11-19T00:38:44.766761+0000","last_clean":"2023-11-19T00:38:44.766761+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:44.766761+0000","last_undegraded":"2023-11-19T00:38:44.766761+0000","last_fullsized":"2023-11-19T00:38:44.766761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766700+0000","last_change":"2023-11-19T00:38:43.774563+0000","last_active":"2023-11-19T00:38:44.766700+0000","last_peered":"2023-11-19T00:38:44.766700+0000","last_clean":"2023-11-19T00:38:44.766700+0000","last_became_active":"2023-11-19T00:38:43.774185+0000","last_became_peered":"2023-11-19T00:38:43.774185+0000","last_unstale":"2023-11-19T00:38:44.766700+0000","last_undegraded":"2023-11-19T00:38:44.766700+0000","last_fullsized":"2023-11-19T00:38:44.766700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:50.184703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781059+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:38:44.781059+0000","last_peered":"2023-11-19T00:38:44.781059+0000","last_clean":"2023-11-19T00:38:44.781059+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:38:44.781059+0000","last_undegraded":"2023-11-19T00:38:44.781059+0000","last_fullsized":"2023-11-19T00:38:44.781059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768473+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:44.768473+0000","last_peered":"2023-11-19T00:38:44.768473+0000","last_clean":"2023-11-19T00:38:44.768473+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:44.768473+0000","last_undegraded":"2023-11-19T00:38:44.768473+0000","last_fullsized":"2023-11-19T00:38:44.768473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772395+0000","last_change":"2023-11-19T00:38:44.778739+0000","last_active":"2023-11-19T00:38:45.772395+0000","last_peered":"2023-11-19T00:38:45.772395+0000","last_clean":"2023-11-19T00:38:45.772395+0000","last_became_active":"2023-11-19T00:38:44.777911+0000","last_became_peered":"2023-11-19T00:38:44.777911+0000","last_unstale":"2023-11-19T00:38:45.772395+0000","last_undegraded":"2023-11-19T00:38:45.772395+0000","last_fullsized":"2023-11-19T00:38:45.772395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773455+0000","last_change":"2023-11-19T00:38:43.776164+0000","last_active":"2023-11-19T00:38:45.773455+0000","last_peered":"2023-11-19T00:38:45.773455+0000","last_clean":"2023-11-19T00:38:45.773455+0000","last_became_active":"2023-11-19T00:38:43.775677+0000","last_became_peered":"2023-11-19T00:38:43.775677+0000","last_unstale":"2023-11-19T00:38:45.773455+0000","last_undegraded":"2023-11-19T00:38:45.773455+0000","last_fullsized":"2023-11-19T00:38:45.773455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:37.708461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772347+0000","last_change":"2023-11-19T00:38:44.774432+0000","last_active":"2023-11-19T00:38:45.772347+0000","last_peered":"2023-11-19T00:38:45.772347+0000","last_clean":"2023-11-19T00:38:45.772347+0000","last_became_active":"2023-11-19T00:38:44.773918+0000","last_became_peered":"2023-11-19T00:38:44.773918+0000","last_unstale":"2023-11-19T00:38:45.772347+0000","last_undegraded":"2023-11-19T00:38:45.772347+0000","last_fullsized":"2023-11-19T00:38:45.772347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772290+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:38:45.772290+0000","last_peered":"2023-11-19T00:38:45.772290+0000","last_clean":"2023-11-19T00:38:45.772290+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:38:45.772290+0000","last_undegraded":"2023-11-19T00:38:45.772290+0000","last_fullsized":"2023-11-19T00:38:45.772290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768675+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:38:44.768675+0000","last_peered":"2023-11-19T00:38:44.768675+0000","last_clean":"2023-11-19T00:38:44.768675+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:38:44.768675+0000","last_undegraded":"2023-11-19T00:38:44.768675+0000","last_fullsized":"2023-11-19T00:38:44.768675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772387+0000","last_change":"2023-11-19T00:38:44.774931+0000","last_active":"2023-11-19T00:38:45.772387+0000","last_peered":"2023-11-19T00:38:45.772387+0000","last_clean":"2023-11-19T00:38:45.772387+0000","last_became_active":"2023-11-19T00:38:44.774619+0000","last_became_peered":"2023-11-19T00:38:44.774619+0000","last_unstale":"2023-11-19T00:38:45.772387+0000","last_undegraded":"2023-11-19T00:38:45.772387+0000","last_fullsized":"2023-11-19T00:38:45.772387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767209+0000","last_change":"2023-11-19T00:38:43.774832+0000","last_active":"2023-11-19T00:38:44.767209+0000","last_peered":"2023-11-19T00:38:44.767209+0000","last_clean":"2023-11-19T00:38:44.767209+0000","last_became_active":"2023-11-19T00:38:43.774270+0000","last_became_peered":"2023-11-19T00:38:43.774270+0000","last_unstale":"2023-11-19T00:38:44.767209+0000","last_undegraded":"2023-11-19T00:38:44.767209+0000","last_fullsized":"2023-11-19T00:38:44.767209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773169+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:38:45.773169+0000","last_peered":"2023-11-19T00:38:45.773169+0000","last_clean":"2023-11-19T00:38:45.773169+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:38:45.773169+0000","last_undegraded":"2023-11-19T00:38:45.773169+0000","last_fullsized":"2023-11-19T00:38:45.773169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768429+0000","last_change":"2023-11-19T00:38:43.768405+0000","last_active":"2023-11-19T00:38:44.768429+0000","last_peered":"2023-11-19T00:38:44.768429+0000","last_clean":"2023-11-19T00:38:44.768429+0000","last_became_active":"2023-11-19T00:38:43.768158+0000","last_became_peered":"2023-11-19T00:38:43.768158+0000","last_unstale":"2023-11-19T00:38:44.768429+0000","last_undegraded":"2023-11-19T00:38:44.768429+0000","last_fullsized":"2023-11-19T00:38:44.768429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.778563+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:38:44.778563+0000","last_peered":"2023-11-19T00:38:44.778563+0000","last_clean":"2023-11-19T00:38:44.778563+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:38:44.778563+0000","last_undegraded":"2023-11-19T00:38:44.778563+0000","last_fullsized":"2023-11-19T00:38:44.778563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.785322+0000","last_change":"2023-11-19T00:38:43.775635+0000","last_active":"2023-11-19T00:38:44.785322+0000","last_peered":"2023-11-19T00:38:44.785322+0000","last_clean":"2023-11-19T00:38:44.785322+0000","last_became_active":"2023-11-19T00:38:43.775203+0000","last_became_peered":"2023-11-19T00:38:43.775203+0000","last_unstale":"2023-11-19T00:38:44.785322+0000","last_undegraded":"2023-11-19T00:38:44.785322+0000","last_fullsized":"2023-11-19T00:38:44.785322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:38:57.527 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-19T00:38:57.527 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-19T00:38:57.527 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-19T00:38:57.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-19T00:38:57.896 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:57.896 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-19T00:38:57.908 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-19T00:38:57.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:38:58.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:58.202 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:45.766733+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:38:58.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-19T00:38:42.590087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-19T00:38:43.103062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-19T00:38:58.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-19T00:38:58.511 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-11-19T00:38:58.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-19T00:38:58.818 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-11-19T00:38:58.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-19T00:38:59.127 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-11-19T00:38:59.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-19T00:38:59.434 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-11-19T00:38:59.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-19T00:38:59.782 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:38:59.782 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-19T00:38:44.121737+0000","modified":"2023-11-19T00:38:46.120615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/3311622644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3311622644},{"type":"v1","addr":"172.21.15.46:6803","nonce":3311622644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-19T00:38:59.782 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2023-11-19T00:38:59.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:39:00.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:00.092 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:45.766733+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:39:00.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-19T00:38:42.590087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-19T00:38:43.103062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-19T00:39:00.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-19T00:39:00.400 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-11-19T00:39:00.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-19T00:39:00.707 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-11-19T00:39:00.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-19T00:39:01.013 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-11-19T00:39:01.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-19T00:39:01.319 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-11-19T00:39:01.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-19T00:39:01.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:01.667 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-19T00:38:44.121737+0000","modified":"2023-11-19T00:38:46.120615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/3311622644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3311622644},{"type":"v1","addr":"172.21.15.46:6803","nonce":3311622644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-19T00:39:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2023-11-19T00:39:01.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:39:01.978 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:01.978 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:38:45.766733+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:39:01.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-19T00:39:02.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:02.322 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-19T00:38:44.121737+0000","modified":"2023-11-19T00:38:46.120615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/3311622644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3311622644},{"type":"v1","addr":"172.21.15.46:6803","nonce":3311622644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-19T00:39:02.322 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2023-11-19T00:39:02.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-19T00:38:44.121737+0000', 'modified': '2023-11-19T00:38:46.120615+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4217}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4217': {'gid': 4217, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6803/3311622644', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6802', 'nonce': 3311622644}, {'type': 'v1', 'addr': '172.21.15.46:6803', 'nonce': 3311622644}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-19T00:39:02.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-19T00:39:02.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-19T00:39:02.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-11-19T00:39:02.554+0000 7f89257fa640 0 client.4638 ms_handle_reset on v2:172.21.15.46:6802/3311622644 2023-11-19T00:39:02.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-11-19T00:39:02.575+0000 7f89257fa640 0 client.4513 ms_handle_reset on v2:172.21.15.46:6802/3311622644 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "8d6e5d21-0548-4be9-97cd-ecd717c3d6dc", 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4217, 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 17.812658048999999, 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 5, 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 19, 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 19, 2023-11-19T00:39:02.576 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 22.72933592 2023-11-19T00:39:02.577 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:39:02.587 INFO:teuthology.run_tasks:Running task thrashosds... 2023-11-19T00:39:02.597 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-11-19T00:39:02.597 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}} 2023-11-19T00:39:02.597 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-11-19T00:39:02.597 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2023-11-19T00:39:02.597 DEBUG:teuthology.orchestra.run.smithi046:> sync 2023-11-19T00:39:02.694 DEBUG:teuthology.orchestra.run.smithi073:> sync 2023-11-19T00:39:02.763 DEBUG:teuthology.orchestra.run.smithi099:> sync 2023-11-19T00:39:02.963 DEBUG:teuthology.orchestra.run.smithi181:> sync 2023-11-19T00:39:03.099 DEBUG:tasks.thrashosds:checking console status of smithi046 2023-11-19T00:39:03.099 DEBUG:teuthology.orchestra.console.smithi046:Waiting for login prompt 2023-11-19T00:39:03.099 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi046 2023-11-19T00:39:03.185 DEBUG:teuthology.orchestra.console.smithi046:expect before: [Enter `^Ec?' for help] 2023-11-19T00:39:03.186 DEBUG:teuthology.orchestra.console.smithi046:expect after: smithi046 login: 2023-11-19T00:39:03.238 DEBUG:teuthology.orchestra.console.smithi046:console disconnect output: [Enter `^Ec?' for help] smithi046 login: [disconnect] 2023-11-19T00:39:03.339 DEBUG:tasks.thrashosds:checking console status of smithi073 2023-11-19T00:39:03.340 DEBUG:teuthology.orchestra.console.smithi073:Waiting for login prompt 2023-11-19T00:39:03.340 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi073 2023-11-19T00:39:03.432 DEBUG:teuthology.orchestra.console.smithi073:expect before: [Enter `^Ec?' for help] 2023-11-19T00:39:03.433 DEBUG:teuthology.orchestra.console.smithi073:expect after: smithi073 login: 2023-11-19T00:39:03.484 DEBUG:teuthology.orchestra.console.smithi073:console disconnect output: [Enter `^Ec?' for help] smithi073 login: [disconnect] 2023-11-19T00:39:03.586 DEBUG:tasks.thrashosds:checking console status of smithi099 2023-11-19T00:39:03.586 DEBUG:teuthology.orchestra.console.smithi099:Waiting for login prompt 2023-11-19T00:39:03.586 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi099 2023-11-19T00:39:03.686 DEBUG:teuthology.orchestra.console.smithi099:expect before: [Enter `^Ec?' for help] 2023-11-19T00:39:03.686 DEBUG:teuthology.orchestra.console.smithi099:expect after: smithi099 login: 2023-11-19T00:39:03.740 DEBUG:teuthology.orchestra.console.smithi099:console disconnect output: [Enter `^Ec?' for help] smithi099 login: [disconnect] 2023-11-19T00:39:03.841 DEBUG:tasks.thrashosds:checking console status of smithi181 2023-11-19T00:39:03.845 DEBUG:teuthology.orchestra.console.smithi181:Waiting for login prompt 2023-11-19T00:39:03.845 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi181 2023-11-19T00:39:04.004 DEBUG:teuthology.orchestra.console.smithi181:expect before: [Enter `^Ec?' for help] 2023-11-19T00:39:04.004 DEBUG:teuthology.orchestra.console.smithi181:expect after: smithi181 login: 2023-11-19T00:39:04.056 DEBUG:teuthology.orchestra.console.smithi181:console disconnect output: [Enter `^Ec?' for help] smithi181 login: [disconnect] 2023-11-19T00:39:04.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-11-19T00:39:04.482 INFO:tasks.thrashosds:Beginning thrashosds... 2023-11-19T00:39:04.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-19T00:39:04.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:39:04.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:39:04.794 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-19T00:39:03.025905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91104,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024416,"statfs":{"total":289910292480,"available":289817001984,"internally_reserved":0,"allocated":1744896,"data_stored":1357843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772977+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:38:45.772977+0000","last_peered":"2023-11-19T00:38:45.772977+0000","last_clean":"2023-11-19T00:38:45.772977+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:38:45.772977+0000","last_undegraded":"2023-11-19T00:38:45.772977+0000","last_fullsized":"2023-11-19T00:38:45.772977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773491+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:38:45.773491+0000","last_peered":"2023-11-19T00:38:45.773491+0000","last_clean":"2023-11-19T00:38:45.773491+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:38:45.773491+0000","last_undegraded":"2023-11-19T00:38:45.773491+0000","last_fullsized":"2023-11-19T00:38:45.773491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772983+0000","last_change":"2023-11-19T00:38:44.774728+0000","last_active":"2023-11-19T00:38:45.772983+0000","last_peered":"2023-11-19T00:38:45.772983+0000","last_clean":"2023-11-19T00:38:45.772983+0000","last_became_active":"2023-11-19T00:38:44.774283+0000","last_became_peered":"2023-11-19T00:38:44.774283+0000","last_unstale":"2023-11-19T00:38:45.772983+0000","last_undegraded":"2023-11-19T00:38:45.772983+0000","last_fullsized":"2023-11-19T00:38:45.772983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772096+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:38:45.772096+0000","last_peered":"2023-11-19T00:38:45.772096+0000","last_clean":"2023-11-19T00:38:45.772096+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:38:45.772096+0000","last_undegraded":"2023-11-19T00:38:45.772096+0000","last_fullsized":"2023-11-19T00:38:45.772096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773248+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:38:45.773248+0000","last_peered":"2023-11-19T00:38:45.773248+0000","last_clean":"2023-11-19T00:38:45.773248+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:38:45.773248+0000","last_undegraded":"2023-11-19T00:38:45.773248+0000","last_fullsized":"2023-11-19T00:38:45.773248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772831+0000","last_change":"2023-11-19T00:38:44.771210+0000","last_active":"2023-11-19T00:38:45.772831+0000","last_peered":"2023-11-19T00:38:45.772831+0000","last_clean":"2023-11-19T00:38:45.772831+0000","last_became_active":"2023-11-19T00:38:44.770785+0000","last_became_peered":"2023-11-19T00:38:44.770785+0000","last_unstale":"2023-11-19T00:38:45.772831+0000","last_undegraded":"2023-11-19T00:38:45.772831+0000","last_fullsized":"2023-11-19T00:38:45.772831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772299+0000","last_change":"2023-11-19T00:38:44.771258+0000","last_active":"2023-11-19T00:38:45.772299+0000","last_peered":"2023-11-19T00:38:45.772299+0000","last_clean":"2023-11-19T00:38:45.772299+0000","last_became_active":"2023-11-19T00:38:44.770632+0000","last_became_peered":"2023-11-19T00:38:44.770632+0000","last_unstale":"2023-11-19T00:38:45.772299+0000","last_undegraded":"2023-11-19T00:38:45.772299+0000","last_fullsized":"2023-11-19T00:38:45.772299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766718+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:38:44.766718+0000","last_peered":"2023-11-19T00:38:44.766718+0000","last_clean":"2023-11-19T00:38:44.766718+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:38:44.766718+0000","last_undegraded":"2023-11-19T00:38:44.766718+0000","last_fullsized":"2023-11-19T00:38:44.766718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773432+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:38:45.773432+0000","last_peered":"2023-11-19T00:38:45.773432+0000","last_clean":"2023-11-19T00:38:45.773432+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:38:45.773432+0000","last_undegraded":"2023-11-19T00:38:45.773432+0000","last_fullsized":"2023-11-19T00:38:45.773432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773080+0000","last_change":"2023-11-19T00:38:44.773267+0000","last_active":"2023-11-19T00:38:45.773080+0000","last_peered":"2023-11-19T00:38:45.773080+0000","last_clean":"2023-11-19T00:38:45.773080+0000","last_became_active":"2023-11-19T00:38:44.772893+0000","last_became_peered":"2023-11-19T00:38:44.772893+0000","last_unstale":"2023-11-19T00:38:45.773080+0000","last_undegraded":"2023-11-19T00:38:45.773080+0000","last_fullsized":"2023-11-19T00:38:45.773080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772985+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:38:45.772985+0000","last_peered":"2023-11-19T00:38:45.772985+0000","last_clean":"2023-11-19T00:38:45.772985+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:38:45.772985+0000","last_undegraded":"2023-11-19T00:38:45.772985+0000","last_fullsized":"2023-11-19T00:38:45.772985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781284+0000","last_change":"2023-11-19T00:38:43.775268+0000","last_active":"2023-11-19T00:38:44.781284+0000","last_peered":"2023-11-19T00:38:44.781284+0000","last_clean":"2023-11-19T00:38:44.781284+0000","last_became_active":"2023-11-19T00:38:43.774979+0000","last_became_peered":"2023-11-19T00:38:43.774979+0000","last_unstale":"2023-11-19T00:38:44.781284+0000","last_undegraded":"2023-11-19T00:38:44.781284+0000","last_fullsized":"2023-11-19T00:38:44.781284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773206+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:38:45.773206+0000","last_peered":"2023-11-19T00:38:45.773206+0000","last_clean":"2023-11-19T00:38:45.773206+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:38:45.773206+0000","last_undegraded":"2023-11-19T00:38:45.773206+0000","last_fullsized":"2023-11-19T00:38:45.773206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767229+0000","last_change":"2023-11-19T00:38:43.775141+0000","last_active":"2023-11-19T00:38:44.767229+0000","last_peered":"2023-11-19T00:38:44.767229+0000","last_clean":"2023-11-19T00:38:44.767229+0000","last_became_active":"2023-11-19T00:38:43.774369+0000","last_became_peered":"2023-11-19T00:38:43.774369+0000","last_unstale":"2023-11-19T00:38:44.767229+0000","last_undegraded":"2023-11-19T00:38:44.767229+0000","last_fullsized":"2023-11-19T00:38:44.767229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769057+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:38:44.769057+0000","last_peered":"2023-11-19T00:38:44.769057+0000","last_clean":"2023-11-19T00:38:44.769057+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:38:44.769057+0000","last_undegraded":"2023-11-19T00:38:44.769057+0000","last_fullsized":"2023-11-19T00:38:44.769057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769186+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:44.769186+0000","last_peered":"2023-11-19T00:38:44.769186+0000","last_clean":"2023-11-19T00:38:44.769186+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:44.769186+0000","last_undegraded":"2023-11-19T00:38:44.769186+0000","last_fullsized":"2023-11-19T00:38:44.769186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773238+0000","last_change":"2023-11-19T00:38:44.776477+0000","last_active":"2023-11-19T00:38:45.773238+0000","last_peered":"2023-11-19T00:38:45.773238+0000","last_clean":"2023-11-19T00:38:45.773238+0000","last_became_active":"2023-11-19T00:38:44.775612+0000","last_became_peered":"2023-11-19T00:38:44.775612+0000","last_unstale":"2023-11-19T00:38:45.773238+0000","last_undegraded":"2023-11-19T00:38:45.773238+0000","last_fullsized":"2023-11-19T00:38:45.773238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773217+0000","last_change":"2023-11-19T00:38:44.774583+0000","last_active":"2023-11-19T00:38:45.773217+0000","last_peered":"2023-11-19T00:38:45.773217+0000","last_clean":"2023-11-19T00:38:45.773217+0000","last_became_active":"2023-11-19T00:38:44.773998+0000","last_became_peered":"2023-11-19T00:38:44.773998+0000","last_unstale":"2023-11-19T00:38:45.773217+0000","last_undegraded":"2023-11-19T00:38:45.773217+0000","last_fullsized":"2023-11-19T00:38:45.773217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766761+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:44.766761+0000","last_peered":"2023-11-19T00:38:44.766761+0000","last_clean":"2023-11-19T00:38:44.766761+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:44.766761+0000","last_undegraded":"2023-11-19T00:38:44.766761+0000","last_fullsized":"2023-11-19T00:38:44.766761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766700+0000","last_change":"2023-11-19T00:38:43.774563+0000","last_active":"2023-11-19T00:38:44.766700+0000","last_peered":"2023-11-19T00:38:44.766700+0000","last_clean":"2023-11-19T00:38:44.766700+0000","last_became_active":"2023-11-19T00:38:43.774185+0000","last_became_peered":"2023-11-19T00:38:43.774185+0000","last_unstale":"2023-11-19T00:38:44.766700+0000","last_undegraded":"2023-11-19T00:38:44.766700+0000","last_fullsized":"2023-11-19T00:38:44.766700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:50.184703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781059+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:38:44.781059+0000","last_peered":"2023-11-19T00:38:44.781059+0000","last_clean":"2023-11-19T00:38:44.781059+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:38:44.781059+0000","last_undegraded":"2023-11-19T00:38:44.781059+0000","last_fullsized":"2023-11-19T00:38:44.781059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768473+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:44.768473+0000","last_peered":"2023-11-19T00:38:44.768473+0000","last_clean":"2023-11-19T00:38:44.768473+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:44.768473+0000","last_undegraded":"2023-11-19T00:38:44.768473+0000","last_fullsized":"2023-11-19T00:38:44.768473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772395+0000","last_change":"2023-11-19T00:38:44.778739+0000","last_active":"2023-11-19T00:38:45.772395+0000","last_peered":"2023-11-19T00:38:45.772395+0000","last_clean":"2023-11-19T00:38:45.772395+0000","last_became_active":"2023-11-19T00:38:44.777911+0000","last_became_peered":"2023-11-19T00:38:44.777911+0000","last_unstale":"2023-11-19T00:38:45.772395+0000","last_undegraded":"2023-11-19T00:38:45.772395+0000","last_fullsized":"2023-11-19T00:38:45.772395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773455+0000","last_change":"2023-11-19T00:38:43.776164+0000","last_active":"2023-11-19T00:38:45.773455+0000","last_peered":"2023-11-19T00:38:45.773455+0000","last_clean":"2023-11-19T00:38:45.773455+0000","last_became_active":"2023-11-19T00:38:43.775677+0000","last_became_peered":"2023-11-19T00:38:43.775677+0000","last_unstale":"2023-11-19T00:38:45.773455+0000","last_undegraded":"2023-11-19T00:38:45.773455+0000","last_fullsized":"2023-11-19T00:38:45.773455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:37.708461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772347+0000","last_change":"2023-11-19T00:38:44.774432+0000","last_active":"2023-11-19T00:38:45.772347+0000","last_peered":"2023-11-19T00:38:45.772347+0000","last_clean":"2023-11-19T00:38:45.772347+0000","last_became_active":"2023-11-19T00:38:44.773918+0000","last_became_peered":"2023-11-19T00:38:44.773918+0000","last_unstale":"2023-11-19T00:38:45.772347+0000","last_undegraded":"2023-11-19T00:38:45.772347+0000","last_fullsized":"2023-11-19T00:38:45.772347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772290+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:38:45.772290+0000","last_peered":"2023-11-19T00:38:45.772290+0000","last_clean":"2023-11-19T00:38:45.772290+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:38:45.772290+0000","last_undegraded":"2023-11-19T00:38:45.772290+0000","last_fullsized":"2023-11-19T00:38:45.772290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768675+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:38:44.768675+0000","last_peered":"2023-11-19T00:38:44.768675+0000","last_clean":"2023-11-19T00:38:44.768675+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:38:44.768675+0000","last_undegraded":"2023-11-19T00:38:44.768675+0000","last_fullsized":"2023-11-19T00:38:44.768675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772387+0000","last_change":"2023-11-19T00:38:44.774931+0000","last_active":"2023-11-19T00:38:45.772387+0000","last_peered":"2023-11-19T00:38:45.772387+0000","last_clean":"2023-11-19T00:38:45.772387+0000","last_became_active":"2023-11-19T00:38:44.774619+0000","last_became_peered":"2023-11-19T00:38:44.774619+0000","last_unstale":"2023-11-19T00:38:45.772387+0000","last_undegraded":"2023-11-19T00:38:45.772387+0000","last_fullsized":"2023-11-19T00:38:45.772387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767209+0000","last_change":"2023-11-19T00:38:43.774832+0000","last_active":"2023-11-19T00:38:44.767209+0000","last_peered":"2023-11-19T00:38:44.767209+0000","last_clean":"2023-11-19T00:38:44.767209+0000","last_became_active":"2023-11-19T00:38:43.774270+0000","last_became_peered":"2023-11-19T00:38:43.774270+0000","last_unstale":"2023-11-19T00:38:44.767209+0000","last_undegraded":"2023-11-19T00:38:44.767209+0000","last_fullsized":"2023-11-19T00:38:44.767209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773169+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:38:45.773169+0000","last_peered":"2023-11-19T00:38:45.773169+0000","last_clean":"2023-11-19T00:38:45.773169+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:38:45.773169+0000","last_undegraded":"2023-11-19T00:38:45.773169+0000","last_fullsized":"2023-11-19T00:38:45.773169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768429+0000","last_change":"2023-11-19T00:38:43.768405+0000","last_active":"2023-11-19T00:38:44.768429+0000","last_peered":"2023-11-19T00:38:44.768429+0000","last_clean":"2023-11-19T00:38:44.768429+0000","last_became_active":"2023-11-19T00:38:43.768158+0000","last_became_peered":"2023-11-19T00:38:43.768158+0000","last_unstale":"2023-11-19T00:38:44.768429+0000","last_undegraded":"2023-11-19T00:38:44.768429+0000","last_fullsized":"2023-11-19T00:38:44.768429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.778563+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:38:44.778563+0000","last_peered":"2023-11-19T00:38:44.778563+0000","last_clean":"2023-11-19T00:38:44.778563+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:38:44.778563+0000","last_undegraded":"2023-11-19T00:38:44.778563+0000","last_fullsized":"2023-11-19T00:38:44.778563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.785322+0000","last_change":"2023-11-19T00:38:43.775635+0000","last_active":"2023-11-19T00:38:44.785322+0000","last_peered":"2023-11-19T00:38:44.785322+0000","last_clean":"2023-11-19T00:38:44.785322+0000","last_became_active":"2023-11-19T00:38:43.775203+0000","last_became_peered":"2023-11-19T00:38:43.775203+0000","last_unstale":"2023-11-19T00:38:44.785322+0000","last_undegraded":"2023-11-19T00:38:44.785322+0000","last_fullsized":"2023-11-19T00:38:44.785322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:39:04.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:39:05.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:39:05.142 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-19T00:39:05.026445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91104,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024416,"statfs":{"total":289910292480,"available":289817001984,"internally_reserved":0,"allocated":1744896,"data_stored":1357843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002921"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816586+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:38:45.816586+0000","last_peered":"2023-11-19T00:38:45.816586+0000","last_clean":"2023-11-19T00:38:45.816586+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:38:45.816586+0000","last_undegraded":"2023-11-19T00:38:45.816586+0000","last_fullsized":"2023-11-19T00:38:45.816586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773138+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:38:45.773138+0000","last_peered":"2023-11-19T00:38:45.773138+0000","last_clean":"2023-11-19T00:38:45.773138+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:38:45.773138+0000","last_undegraded":"2023-11-19T00:38:45.773138+0000","last_fullsized":"2023-11-19T00:38:45.773138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772958+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:38:45.772958+0000","last_peered":"2023-11-19T00:38:45.772958+0000","last_clean":"2023-11-19T00:38:45.772958+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:38:45.772958+0000","last_undegraded":"2023-11-19T00:38:45.772958+0000","last_fullsized":"2023-11-19T00:38:45.772958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816330+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:38:45.816330+0000","last_peered":"2023-11-19T00:38:45.816330+0000","last_clean":"2023-11-19T00:38:45.816330+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:38:45.816330+0000","last_undegraded":"2023-11-19T00:38:45.816330+0000","last_fullsized":"2023-11-19T00:38:45.816330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772541+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:38:45.772541+0000","last_peered":"2023-11-19T00:38:45.772541+0000","last_clean":"2023-11-19T00:38:45.772541+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:38:45.772541+0000","last_undegraded":"2023-11-19T00:38:45.772541+0000","last_fullsized":"2023-11-19T00:38:45.772541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772576+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:38:45.772576+0000","last_peered":"2023-11-19T00:38:45.772576+0000","last_clean":"2023-11-19T00:38:45.772576+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:38:45.772576+0000","last_undegraded":"2023-11-19T00:38:45.772576+0000","last_fullsized":"2023-11-19T00:38:45.772576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772273+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:38:45.772273+0000","last_peered":"2023-11-19T00:38:45.772273+0000","last_clean":"2023-11-19T00:38:45.772273+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:38:45.772273+0000","last_undegraded":"2023-11-19T00:38:45.772273+0000","last_fullsized":"2023-11-19T00:38:45.772273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772977+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:38:45.772977+0000","last_peered":"2023-11-19T00:38:45.772977+0000","last_clean":"2023-11-19T00:38:45.772977+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:38:45.772977+0000","last_undegraded":"2023-11-19T00:38:45.772977+0000","last_fullsized":"2023-11-19T00:38:45.772977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816680+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:38:45.816680+0000","last_peered":"2023-11-19T00:38:45.816680+0000","last_clean":"2023-11-19T00:38:45.816680+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:38:45.816680+0000","last_undegraded":"2023-11-19T00:38:45.816680+0000","last_fullsized":"2023-11-19T00:38:45.816680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773486+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:38:45.773486+0000","last_peered":"2023-11-19T00:38:45.773486+0000","last_clean":"2023-11-19T00:38:45.773486+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:38:45.773486+0000","last_undegraded":"2023-11-19T00:38:45.773486+0000","last_fullsized":"2023-11-19T00:38:45.773486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816352+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:38:45.816352+0000","last_peered":"2023-11-19T00:38:45.816352+0000","last_clean":"2023-11-19T00:38:45.816352+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:38:45.816352+0000","last_undegraded":"2023-11-19T00:38:45.816352+0000","last_fullsized":"2023-11-19T00:38:45.816352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816103+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:38:45.816103+0000","last_peered":"2023-11-19T00:38:45.816103+0000","last_clean":"2023-11-19T00:38:45.816103+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:38:45.816103+0000","last_undegraded":"2023-11-19T00:38:45.816103+0000","last_fullsized":"2023-11-19T00:38:45.816103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772620+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:38:45.772620+0000","last_peered":"2023-11-19T00:38:45.772620+0000","last_clean":"2023-11-19T00:38:45.772620+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:38:45.772620+0000","last_undegraded":"2023-11-19T00:38:45.772620+0000","last_fullsized":"2023-11-19T00:38:45.772620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772661+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:38:45.772661+0000","last_peered":"2023-11-19T00:38:45.772661+0000","last_clean":"2023-11-19T00:38:45.772661+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:38:45.772661+0000","last_undegraded":"2023-11-19T00:38:45.772661+0000","last_fullsized":"2023-11-19T00:38:45.772661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772292+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:38:45.772292+0000","last_peered":"2023-11-19T00:38:45.772292+0000","last_clean":"2023-11-19T00:38:45.772292+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:38:45.772292+0000","last_undegraded":"2023-11-19T00:38:45.772292+0000","last_fullsized":"2023-11-19T00:38:45.772292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773491+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:38:45.773491+0000","last_peered":"2023-11-19T00:38:45.773491+0000","last_clean":"2023-11-19T00:38:45.773491+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:38:45.773491+0000","last_undegraded":"2023-11-19T00:38:45.773491+0000","last_fullsized":"2023-11-19T00:38:45.773491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816885+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:38:45.816885+0000","last_peered":"2023-11-19T00:38:45.816885+0000","last_clean":"2023-11-19T00:38:45.816885+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:38:45.816885+0000","last_undegraded":"2023-11-19T00:38:45.816885+0000","last_fullsized":"2023-11-19T00:38:45.816885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772983+0000","last_change":"2023-11-19T00:38:44.774728+0000","last_active":"2023-11-19T00:38:45.772983+0000","last_peered":"2023-11-19T00:38:45.772983+0000","last_clean":"2023-11-19T00:38:45.772983+0000","last_became_active":"2023-11-19T00:38:44.774283+0000","last_became_peered":"2023-11-19T00:38:44.774283+0000","last_unstale":"2023-11-19T00:38:45.772983+0000","last_undegraded":"2023-11-19T00:38:45.772983+0000","last_fullsized":"2023-11-19T00:38:45.772983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772939+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:38:45.772939+0000","last_peered":"2023-11-19T00:38:45.772939+0000","last_clean":"2023-11-19T00:38:45.772939+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:38:45.772939+0000","last_undegraded":"2023-11-19T00:38:45.772939+0000","last_fullsized":"2023-11-19T00:38:45.772939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773260+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:38:45.773260+0000","last_peered":"2023-11-19T00:38:45.773260+0000","last_clean":"2023-11-19T00:38:45.773260+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:38:45.773260+0000","last_undegraded":"2023-11-19T00:38:45.773260+0000","last_fullsized":"2023-11-19T00:38:45.773260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815885+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:38:45.815885+0000","last_peered":"2023-11-19T00:38:45.815885+0000","last_clean":"2023-11-19T00:38:45.815885+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:38:45.815885+0000","last_undegraded":"2023-11-19T00:38:45.815885+0000","last_fullsized":"2023-11-19T00:38:45.815885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772096+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:38:45.772096+0000","last_peered":"2023-11-19T00:38:45.772096+0000","last_clean":"2023-11-19T00:38:45.772096+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:38:45.772096+0000","last_undegraded":"2023-11-19T00:38:45.772096+0000","last_fullsized":"2023-11-19T00:38:45.772096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815739+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:38:45.815739+0000","last_peered":"2023-11-19T00:38:45.815739+0000","last_clean":"2023-11-19T00:38:45.815739+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:38:45.815739+0000","last_undegraded":"2023-11-19T00:38:45.815739+0000","last_fullsized":"2023-11-19T00:38:45.815739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816946+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:38:45.816946+0000","last_peered":"2023-11-19T00:38:45.816946+0000","last_clean":"2023-11-19T00:38:45.816946+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:38:45.816946+0000","last_undegraded":"2023-11-19T00:38:45.816946+0000","last_fullsized":"2023-11-19T00:38:45.816946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773248+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:38:45.773248+0000","last_peered":"2023-11-19T00:38:45.773248+0000","last_clean":"2023-11-19T00:38:45.773248+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:38:45.773248+0000","last_undegraded":"2023-11-19T00:38:45.773248+0000","last_fullsized":"2023-11-19T00:38:45.773248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773363+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:38:45.773363+0000","last_peered":"2023-11-19T00:38:45.773363+0000","last_clean":"2023-11-19T00:38:45.773363+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:38:45.773363+0000","last_undegraded":"2023-11-19T00:38:45.773363+0000","last_fullsized":"2023-11-19T00:38:45.773363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816585+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:38:45.816585+0000","last_peered":"2023-11-19T00:38:45.816585+0000","last_clean":"2023-11-19T00:38:45.816585+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:38:45.816585+0000","last_undegraded":"2023-11-19T00:38:45.816585+0000","last_fullsized":"2023-11-19T00:38:45.816585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772831+0000","last_change":"2023-11-19T00:38:44.771210+0000","last_active":"2023-11-19T00:38:45.772831+0000","last_peered":"2023-11-19T00:38:45.772831+0000","last_clean":"2023-11-19T00:38:45.772831+0000","last_became_active":"2023-11-19T00:38:44.770785+0000","last_became_peered":"2023-11-19T00:38:44.770785+0000","last_unstale":"2023-11-19T00:38:45.772831+0000","last_undegraded":"2023-11-19T00:38:45.772831+0000","last_fullsized":"2023-11-19T00:38:45.772831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816117+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:38:45.816117+0000","last_peered":"2023-11-19T00:38:45.816117+0000","last_clean":"2023-11-19T00:38:45.816117+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:38:45.816117+0000","last_undegraded":"2023-11-19T00:38:45.816117+0000","last_fullsized":"2023-11-19T00:38:45.816117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772299+0000","last_change":"2023-11-19T00:38:44.771258+0000","last_active":"2023-11-19T00:38:45.772299+0000","last_peered":"2023-11-19T00:38:45.772299+0000","last_clean":"2023-11-19T00:38:45.772299+0000","last_became_active":"2023-11-19T00:38:44.770632+0000","last_became_peered":"2023-11-19T00:38:44.770632+0000","last_unstale":"2023-11-19T00:38:45.772299+0000","last_undegraded":"2023-11-19T00:38:45.772299+0000","last_fullsized":"2023-11-19T00:38:45.772299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772543+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:38:45.772543+0000","last_peered":"2023-11-19T00:38:45.772543+0000","last_clean":"2023-11-19T00:38:45.772543+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:38:45.772543+0000","last_undegraded":"2023-11-19T00:38:45.772543+0000","last_fullsized":"2023-11-19T00:38:45.772543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816557+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:38:45.816557+0000","last_peered":"2023-11-19T00:38:45.816557+0000","last_clean":"2023-11-19T00:38:45.816557+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:38:45.816557+0000","last_undegraded":"2023-11-19T00:38:45.816557+0000","last_fullsized":"2023-11-19T00:38:45.816557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773140+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:38:45.773140+0000","last_peered":"2023-11-19T00:38:45.773140+0000","last_clean":"2023-11-19T00:38:45.773140+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:38:45.773140+0000","last_undegraded":"2023-11-19T00:38:45.773140+0000","last_fullsized":"2023-11-19T00:38:45.773140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816756+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:38:45.816756+0000","last_peered":"2023-11-19T00:38:45.816756+0000","last_clean":"2023-11-19T00:38:45.816756+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:38:45.816756+0000","last_undegraded":"2023-11-19T00:38:45.816756+0000","last_fullsized":"2023-11-19T00:38:45.816756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766718+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:38:44.766718+0000","last_peered":"2023-11-19T00:38:44.766718+0000","last_clean":"2023-11-19T00:38:44.766718+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:38:44.766718+0000","last_undegraded":"2023-11-19T00:38:44.766718+0000","last_fullsized":"2023-11-19T00:38:44.766718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773432+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:38:45.773432+0000","last_peered":"2023-11-19T00:38:45.773432+0000","last_clean":"2023-11-19T00:38:45.773432+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:38:45.773432+0000","last_undegraded":"2023-11-19T00:38:45.773432+0000","last_fullsized":"2023-11-19T00:38:45.773432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815879+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:38:45.815879+0000","last_peered":"2023-11-19T00:38:45.815879+0000","last_clean":"2023-11-19T00:38:45.815879+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:38:45.815879+0000","last_undegraded":"2023-11-19T00:38:45.815879+0000","last_fullsized":"2023-11-19T00:38:45.815879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773080+0000","last_change":"2023-11-19T00:38:44.773267+0000","last_active":"2023-11-19T00:38:45.773080+0000","last_peered":"2023-11-19T00:38:45.773080+0000","last_clean":"2023-11-19T00:38:45.773080+0000","last_became_active":"2023-11-19T00:38:44.772893+0000","last_became_peered":"2023-11-19T00:38:44.772893+0000","last_unstale":"2023-11-19T00:38:45.773080+0000","last_undegraded":"2023-11-19T00:38:45.773080+0000","last_fullsized":"2023-11-19T00:38:45.773080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772551+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:38:45.772551+0000","last_peered":"2023-11-19T00:38:45.772551+0000","last_clean":"2023-11-19T00:38:45.772551+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:38:45.772551+0000","last_undegraded":"2023-11-19T00:38:45.772551+0000","last_fullsized":"2023-11-19T00:38:45.772551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773460+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:38:45.773460+0000","last_peered":"2023-11-19T00:38:45.773460+0000","last_clean":"2023-11-19T00:38:45.773460+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:38:45.773460+0000","last_undegraded":"2023-11-19T00:38:45.773460+0000","last_fullsized":"2023-11-19T00:38:45.773460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815751+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:38:45.815751+0000","last_peered":"2023-11-19T00:38:45.815751+0000","last_clean":"2023-11-19T00:38:45.815751+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:38:45.815751+0000","last_undegraded":"2023-11-19T00:38:45.815751+0000","last_fullsized":"2023-11-19T00:38:45.815751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816908+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:38:45.816908+0000","last_peered":"2023-11-19T00:38:45.816908+0000","last_clean":"2023-11-19T00:38:45.816908+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:38:45.816908+0000","last_undegraded":"2023-11-19T00:38:45.816908+0000","last_fullsized":"2023-11-19T00:38:45.816908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815752+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:38:45.815752+0000","last_peered":"2023-11-19T00:38:45.815752+0000","last_clean":"2023-11-19T00:38:45.815752+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:38:45.815752+0000","last_undegraded":"2023-11-19T00:38:45.815752+0000","last_fullsized":"2023-11-19T00:38:45.815752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773659+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:38:45.773659+0000","last_peered":"2023-11-19T00:38:45.773659+0000","last_clean":"2023-11-19T00:38:45.773659+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:38:45.773659+0000","last_undegraded":"2023-11-19T00:38:45.773659+0000","last_fullsized":"2023-11-19T00:38:45.773659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773304+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:38:45.773304+0000","last_peered":"2023-11-19T00:38:45.773304+0000","last_clean":"2023-11-19T00:38:45.773304+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:38:45.773304+0000","last_undegraded":"2023-11-19T00:38:45.773304+0000","last_fullsized":"2023-11-19T00:38:45.773304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773377+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:38:45.773377+0000","last_peered":"2023-11-19T00:38:45.773377+0000","last_clean":"2023-11-19T00:38:45.773377+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:38:45.773377+0000","last_undegraded":"2023-11-19T00:38:45.773377+0000","last_fullsized":"2023-11-19T00:38:45.773377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772985+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:38:45.772985+0000","last_peered":"2023-11-19T00:38:45.772985+0000","last_clean":"2023-11-19T00:38:45.772985+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:38:45.772985+0000","last_undegraded":"2023-11-19T00:38:45.772985+0000","last_fullsized":"2023-11-19T00:38:45.772985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781284+0000","last_change":"2023-11-19T00:38:43.775268+0000","last_active":"2023-11-19T00:38:44.781284+0000","last_peered":"2023-11-19T00:38:44.781284+0000","last_clean":"2023-11-19T00:38:44.781284+0000","last_became_active":"2023-11-19T00:38:43.774979+0000","last_became_peered":"2023-11-19T00:38:43.774979+0000","last_unstale":"2023-11-19T00:38:44.781284+0000","last_undegraded":"2023-11-19T00:38:44.781284+0000","last_fullsized":"2023-11-19T00:38:44.781284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773426+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:38:45.773426+0000","last_peered":"2023-11-19T00:38:45.773426+0000","last_clean":"2023-11-19T00:38:45.773426+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:38:45.773426+0000","last_undegraded":"2023-11-19T00:38:45.773426+0000","last_fullsized":"2023-11-19T00:38:45.773426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773508+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:38:45.773508+0000","last_peered":"2023-11-19T00:38:45.773508+0000","last_clean":"2023-11-19T00:38:45.773508+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:38:45.773508+0000","last_undegraded":"2023-11-19T00:38:45.773508+0000","last_fullsized":"2023-11-19T00:38:45.773508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773602+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:38:45.773602+0000","last_peered":"2023-11-19T00:38:45.773602+0000","last_clean":"2023-11-19T00:38:45.773602+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:38:45.773602+0000","last_undegraded":"2023-11-19T00:38:45.773602+0000","last_fullsized":"2023-11-19T00:38:45.773602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816229+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:38:45.816229+0000","last_peered":"2023-11-19T00:38:45.816229+0000","last_clean":"2023-11-19T00:38:45.816229+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:38:45.816229+0000","last_undegraded":"2023-11-19T00:38:45.816229+0000","last_fullsized":"2023-11-19T00:38:45.816229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773182+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:38:45.773182+0000","last_peered":"2023-11-19T00:38:45.773182+0000","last_clean":"2023-11-19T00:38:45.773182+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:38:45.773182+0000","last_undegraded":"2023-11-19T00:38:45.773182+0000","last_fullsized":"2023-11-19T00:38:45.773182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815929+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:38:45.815929+0000","last_peered":"2023-11-19T00:38:45.815929+0000","last_clean":"2023-11-19T00:38:45.815929+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:38:45.815929+0000","last_undegraded":"2023-11-19T00:38:45.815929+0000","last_fullsized":"2023-11-19T00:38:45.815929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773206+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:38:45.773206+0000","last_peered":"2023-11-19T00:38:45.773206+0000","last_clean":"2023-11-19T00:38:45.773206+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:38:45.773206+0000","last_undegraded":"2023-11-19T00:38:45.773206+0000","last_fullsized":"2023-11-19T00:38:45.773206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776406+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:38:44.776406+0000","last_peered":"2023-11-19T00:38:44.776406+0000","last_clean":"2023-11-19T00:38:44.776406+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:38:44.776406+0000","last_undegraded":"2023-11-19T00:38:44.776406+0000","last_fullsized":"2023-11-19T00:38:44.776406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776115+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:38:44.776115+0000","last_peered":"2023-11-19T00:38:44.776115+0000","last_clean":"2023-11-19T00:38:44.776115+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:38:44.776115+0000","last_undegraded":"2023-11-19T00:38:44.776115+0000","last_fullsized":"2023-11-19T00:38:44.776115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767229+0000","last_change":"2023-11-19T00:38:43.775141+0000","last_active":"2023-11-19T00:38:44.767229+0000","last_peered":"2023-11-19T00:38:44.767229+0000","last_clean":"2023-11-19T00:38:44.767229+0000","last_became_active":"2023-11-19T00:38:43.774369+0000","last_became_peered":"2023-11-19T00:38:43.774369+0000","last_unstale":"2023-11-19T00:38:44.767229+0000","last_undegraded":"2023-11-19T00:38:44.767229+0000","last_fullsized":"2023-11-19T00:38:44.767229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773609+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:38:45.773609+0000","last_peered":"2023-11-19T00:38:45.773609+0000","last_clean":"2023-11-19T00:38:45.773609+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:38:45.773609+0000","last_undegraded":"2023-11-19T00:38:45.773609+0000","last_fullsized":"2023-11-19T00:38:45.773609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.776229+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:38:44.776229+0000","last_peered":"2023-11-19T00:38:44.776229+0000","last_clean":"2023-11-19T00:38:44.776229+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:38:44.776229+0000","last_undegraded":"2023-11-19T00:38:44.776229+0000","last_fullsized":"2023-11-19T00:38:44.776229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769057+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:38:44.769057+0000","last_peered":"2023-11-19T00:38:44.769057+0000","last_clean":"2023-11-19T00:38:44.769057+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:38:44.769057+0000","last_undegraded":"2023-11-19T00:38:44.769057+0000","last_fullsized":"2023-11-19T00:38:44.769057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816740+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:38:45.816740+0000","last_peered":"2023-11-19T00:38:45.816740+0000","last_clean":"2023-11-19T00:38:45.816740+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:38:45.816740+0000","last_undegraded":"2023-11-19T00:38:45.816740+0000","last_fullsized":"2023-11-19T00:38:45.816740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.769186+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:38:44.769186+0000","last_peered":"2023-11-19T00:38:44.769186+0000","last_clean":"2023-11-19T00:38:44.769186+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:38:44.769186+0000","last_undegraded":"2023-11-19T00:38:44.769186+0000","last_fullsized":"2023-11-19T00:38:44.769186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816274+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:38:45.816274+0000","last_peered":"2023-11-19T00:38:45.816274+0000","last_clean":"2023-11-19T00:38:45.816274+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:38:45.816274+0000","last_undegraded":"2023-11-19T00:38:45.816274+0000","last_fullsized":"2023-11-19T00:38:45.816274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773238+0000","last_change":"2023-11-19T00:38:44.776477+0000","last_active":"2023-11-19T00:38:45.773238+0000","last_peered":"2023-11-19T00:38:45.773238+0000","last_clean":"2023-11-19T00:38:45.773238+0000","last_became_active":"2023-11-19T00:38:44.775612+0000","last_became_peered":"2023-11-19T00:38:44.775612+0000","last_unstale":"2023-11-19T00:38:45.773238+0000","last_undegraded":"2023-11-19T00:38:45.773238+0000","last_fullsized":"2023-11-19T00:38:45.773238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.774302+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:38:44.774302+0000","last_peered":"2023-11-19T00:38:44.774302+0000","last_clean":"2023-11-19T00:38:44.774302+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:38:44.774302+0000","last_undegraded":"2023-11-19T00:38:44.774302+0000","last_fullsized":"2023-11-19T00:38:44.774302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773438+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:38:45.773438+0000","last_peered":"2023-11-19T00:38:45.773438+0000","last_clean":"2023-11-19T00:38:45.773438+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:38:45.773438+0000","last_undegraded":"2023-11-19T00:38:45.773438+0000","last_fullsized":"2023-11-19T00:38:45.773438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773217+0000","last_change":"2023-11-19T00:38:44.774583+0000","last_active":"2023-11-19T00:38:45.773217+0000","last_peered":"2023-11-19T00:38:45.773217+0000","last_clean":"2023-11-19T00:38:45.773217+0000","last_became_active":"2023-11-19T00:38:44.773998+0000","last_became_peered":"2023-11-19T00:38:44.773998+0000","last_unstale":"2023-11-19T00:38:45.773217+0000","last_undegraded":"2023-11-19T00:38:45.773217+0000","last_fullsized":"2023-11-19T00:38:45.773217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773661+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:38:45.773661+0000","last_peered":"2023-11-19T00:38:45.773661+0000","last_clean":"2023-11-19T00:38:45.773661+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:38:45.773661+0000","last_undegraded":"2023-11-19T00:38:45.773661+0000","last_fullsized":"2023-11-19T00:38:45.773661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766761+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:38:44.766761+0000","last_peered":"2023-11-19T00:38:44.766761+0000","last_clean":"2023-11-19T00:38:44.766761+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:38:44.766761+0000","last_undegraded":"2023-11-19T00:38:44.766761+0000","last_fullsized":"2023-11-19T00:38:44.766761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815920+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:38:45.815920+0000","last_peered":"2023-11-19T00:38:45.815920+0000","last_clean":"2023-11-19T00:38:45.815920+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:38:45.815920+0000","last_undegraded":"2023-11-19T00:38:45.815920+0000","last_fullsized":"2023-11-19T00:38:45.815920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.766700+0000","last_change":"2023-11-19T00:38:43.774563+0000","last_active":"2023-11-19T00:38:44.766700+0000","last_peered":"2023-11-19T00:38:44.766700+0000","last_clean":"2023-11-19T00:38:44.766700+0000","last_became_active":"2023-11-19T00:38:43.774185+0000","last_became_peered":"2023-11-19T00:38:43.774185+0000","last_unstale":"2023-11-19T00:38:44.766700+0000","last_undegraded":"2023-11-19T00:38:44.766700+0000","last_fullsized":"2023-11-19T00:38:44.766700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:50.184703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767516+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:38:44.767516+0000","last_peered":"2023-11-19T00:38:44.767516+0000","last_clean":"2023-11-19T00:38:44.767516+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:38:44.767516+0000","last_undegraded":"2023-11-19T00:38:44.767516+0000","last_fullsized":"2023-11-19T00:38:44.767516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816143+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:38:45.816143+0000","last_peered":"2023-11-19T00:38:45.816143+0000","last_clean":"2023-11-19T00:38:45.816143+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:38:45.816143+0000","last_undegraded":"2023-11-19T00:38:45.816143+0000","last_fullsized":"2023-11-19T00:38:45.816143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.781059+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:38:44.781059+0000","last_peered":"2023-11-19T00:38:44.781059+0000","last_clean":"2023-11-19T00:38:44.781059+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:38:44.781059+0000","last_undegraded":"2023-11-19T00:38:44.781059+0000","last_fullsized":"2023-11-19T00:38:44.781059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768473+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:38:44.768473+0000","last_peered":"2023-11-19T00:38:44.768473+0000","last_clean":"2023-11-19T00:38:44.768473+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:38:44.768473+0000","last_undegraded":"2023-11-19T00:38:44.768473+0000","last_fullsized":"2023-11-19T00:38:44.768473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772395+0000","last_change":"2023-11-19T00:38:44.778739+0000","last_active":"2023-11-19T00:38:45.772395+0000","last_peered":"2023-11-19T00:38:45.772395+0000","last_clean":"2023-11-19T00:38:45.772395+0000","last_became_active":"2023-11-19T00:38:44.777911+0000","last_became_peered":"2023-11-19T00:38:44.777911+0000","last_unstale":"2023-11-19T00:38:45.772395+0000","last_undegraded":"2023-11-19T00:38:45.772395+0000","last_fullsized":"2023-11-19T00:38:45.772395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773455+0000","last_change":"2023-11-19T00:38:43.776164+0000","last_active":"2023-11-19T00:38:45.773455+0000","last_peered":"2023-11-19T00:38:45.773455+0000","last_clean":"2023-11-19T00:38:45.773455+0000","last_became_active":"2023-11-19T00:38:43.775677+0000","last_became_peered":"2023-11-19T00:38:43.775677+0000","last_unstale":"2023-11-19T00:38:45.773455+0000","last_undegraded":"2023-11-19T00:38:45.773455+0000","last_fullsized":"2023-11-19T00:38:45.773455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:37.708461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.773363+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:38:44.773363+0000","last_peered":"2023-11-19T00:38:44.773363+0000","last_clean":"2023-11-19T00:38:44.773363+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:38:44.773363+0000","last_undegraded":"2023-11-19T00:38:44.773363+0000","last_fullsized":"2023-11-19T00:38:44.773363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.815849+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:38:45.815849+0000","last_peered":"2023-11-19T00:38:45.815849+0000","last_clean":"2023-11-19T00:38:45.815849+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:38:45.815849+0000","last_undegraded":"2023-11-19T00:38:45.815849+0000","last_fullsized":"2023-11-19T00:38:45.815849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773037+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:38:45.773037+0000","last_peered":"2023-11-19T00:38:45.773037+0000","last_clean":"2023-11-19T00:38:45.773037+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:38:45.773037+0000","last_undegraded":"2023-11-19T00:38:45.773037+0000","last_fullsized":"2023-11-19T00:38:45.773037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773209+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:38:45.773209+0000","last_peered":"2023-11-19T00:38:45.773209+0000","last_clean":"2023-11-19T00:38:45.773209+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:38:45.773209+0000","last_undegraded":"2023-11-19T00:38:45.773209+0000","last_fullsized":"2023-11-19T00:38:45.773209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772347+0000","last_change":"2023-11-19T00:38:44.774432+0000","last_active":"2023-11-19T00:38:45.772347+0000","last_peered":"2023-11-19T00:38:45.772347+0000","last_clean":"2023-11-19T00:38:45.772347+0000","last_became_active":"2023-11-19T00:38:44.773918+0000","last_became_peered":"2023-11-19T00:38:44.773918+0000","last_unstale":"2023-11-19T00:38:45.772347+0000","last_undegraded":"2023-11-19T00:38:45.772347+0000","last_fullsized":"2023-11-19T00:38:45.772347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817005+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:38:45.817005+0000","last_peered":"2023-11-19T00:38:45.817005+0000","last_clean":"2023-11-19T00:38:45.817005+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:38:45.817005+0000","last_undegraded":"2023-11-19T00:38:45.817005+0000","last_fullsized":"2023-11-19T00:38:45.817005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773350+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:38:45.773350+0000","last_peered":"2023-11-19T00:38:45.773350+0000","last_clean":"2023-11-19T00:38:45.773350+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:38:45.773350+0000","last_undegraded":"2023-11-19T00:38:45.773350+0000","last_fullsized":"2023-11-19T00:38:45.773350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772290+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:38:45.772290+0000","last_peered":"2023-11-19T00:38:45.772290+0000","last_clean":"2023-11-19T00:38:45.772290+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:38:45.772290+0000","last_undegraded":"2023-11-19T00:38:45.772290+0000","last_fullsized":"2023-11-19T00:38:45.772290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768675+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:38:44.768675+0000","last_peered":"2023-11-19T00:38:44.768675+0000","last_clean":"2023-11-19T00:38:44.768675+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:38:44.768675+0000","last_undegraded":"2023-11-19T00:38:44.768675+0000","last_fullsized":"2023-11-19T00:38:44.768675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772387+0000","last_change":"2023-11-19T00:38:44.774931+0000","last_active":"2023-11-19T00:38:45.772387+0000","last_peered":"2023-11-19T00:38:45.772387+0000","last_clean":"2023-11-19T00:38:45.772387+0000","last_became_active":"2023-11-19T00:38:44.774619+0000","last_became_peered":"2023-11-19T00:38:44.774619+0000","last_unstale":"2023-11-19T00:38:45.772387+0000","last_undegraded":"2023-11-19T00:38:45.772387+0000","last_fullsized":"2023-11-19T00:38:45.772387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.817011+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:38:45.817011+0000","last_peered":"2023-11-19T00:38:45.817011+0000","last_clean":"2023-11-19T00:38:45.817011+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:38:45.817011+0000","last_undegraded":"2023-11-19T00:38:45.817011+0000","last_fullsized":"2023-11-19T00:38:45.817011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.767209+0000","last_change":"2023-11-19T00:38:43.774832+0000","last_active":"2023-11-19T00:38:44.767209+0000","last_peered":"2023-11-19T00:38:44.767209+0000","last_clean":"2023-11-19T00:38:44.767209+0000","last_became_active":"2023-11-19T00:38:43.774270+0000","last_became_peered":"2023-11-19T00:38:43.774270+0000","last_unstale":"2023-11-19T00:38:44.767209+0000","last_undegraded":"2023-11-19T00:38:44.767209+0000","last_fullsized":"2023-11-19T00:38:44.767209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773169+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:38:45.773169+0000","last_peered":"2023-11-19T00:38:45.773169+0000","last_clean":"2023-11-19T00:38:45.773169+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:38:45.773169+0000","last_undegraded":"2023-11-19T00:38:45.773169+0000","last_fullsized":"2023-11-19T00:38:45.773169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.768429+0000","last_change":"2023-11-19T00:38:43.768405+0000","last_active":"2023-11-19T00:38:44.768429+0000","last_peered":"2023-11-19T00:38:44.768429+0000","last_clean":"2023-11-19T00:38:44.768429+0000","last_became_active":"2023-11-19T00:38:43.768158+0000","last_became_peered":"2023-11-19T00:38:43.768158+0000","last_unstale":"2023-11-19T00:38:44.768429+0000","last_undegraded":"2023-11-19T00:38:44.768429+0000","last_fullsized":"2023-11-19T00:38:44.768429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816524+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:38:45.816524+0000","last_peered":"2023-11-19T00:38:45.816524+0000","last_clean":"2023-11-19T00:38:45.816524+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:38:45.816524+0000","last_undegraded":"2023-11-19T00:38:45.816524+0000","last_fullsized":"2023-11-19T00:38:45.816524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816104+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:38:45.816104+0000","last_peered":"2023-11-19T00:38:45.816104+0000","last_clean":"2023-11-19T00:38:45.816104+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:38:45.816104+0000","last_undegraded":"2023-11-19T00:38:45.816104+0000","last_fullsized":"2023-11-19T00:38:45.816104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816409+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:38:45.816409+0000","last_peered":"2023-11-19T00:38:45.816409+0000","last_clean":"2023-11-19T00:38:45.816409+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:38:45.816409+0000","last_undegraded":"2023-11-19T00:38:45.816409+0000","last_fullsized":"2023-11-19T00:38:45.816409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816390+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:38:45.816390+0000","last_peered":"2023-11-19T00:38:45.816390+0000","last_clean":"2023-11-19T00:38:45.816390+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:38:45.816390+0000","last_undegraded":"2023-11-19T00:38:45.816390+0000","last_fullsized":"2023-11-19T00:38:45.816390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772871+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:38:45.772871+0000","last_peered":"2023-11-19T00:38:45.772871+0000","last_clean":"2023-11-19T00:38:45.772871+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:38:45.772871+0000","last_undegraded":"2023-11-19T00:38:45.772871+0000","last_fullsized":"2023-11-19T00:38:45.772871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773091+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:38:45.773091+0000","last_peered":"2023-11-19T00:38:45.773091+0000","last_clean":"2023-11-19T00:38:45.773091+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:38:45.773091+0000","last_undegraded":"2023-11-19T00:38:45.773091+0000","last_fullsized":"2023-11-19T00:38:45.773091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.773352+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:38:45.773352+0000","last_peered":"2023-11-19T00:38:45.773352+0000","last_clean":"2023-11-19T00:38:45.773352+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:38:45.773352+0000","last_undegraded":"2023-11-19T00:38:45.773352+0000","last_fullsized":"2023-11-19T00:38:45.773352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816881+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:38:45.816881+0000","last_peered":"2023-11-19T00:38:45.816881+0000","last_clean":"2023-11-19T00:38:45.816881+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:38:45.816881+0000","last_undegraded":"2023-11-19T00:38:45.816881+0000","last_fullsized":"2023-11-19T00:38:45.816881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.816359+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:38:45.816359+0000","last_peered":"2023-11-19T00:38:45.816359+0000","last_clean":"2023-11-19T00:38:45.816359+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:38:45.816359+0000","last_undegraded":"2023-11-19T00:38:45.816359+0000","last_fullsized":"2023-11-19T00:38:45.816359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.778563+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:38:44.778563+0000","last_peered":"2023-11-19T00:38:44.778563+0000","last_clean":"2023-11-19T00:38:44.778563+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:38:44.778563+0000","last_undegraded":"2023-11-19T00:38:44.778563+0000","last_fullsized":"2023-11-19T00:38:44.778563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-19T00:38:45.772708+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:38:45.772708+0000","last_peered":"2023-11-19T00:38:45.772708+0000","last_clean":"2023-11-19T00:38:45.772708+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:38:45.772708+0000","last_undegraded":"2023-11-19T00:38:45.772708+0000","last_fullsized":"2023-11-19T00:38:45.772708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-19T00:38:44.785322+0000","last_change":"2023-11-19T00:38:43.775635+0000","last_active":"2023-11-19T00:38:44.785322+0000","last_peered":"2023-11-19T00:38:44.785322+0000","last_clean":"2023-11-19T00:38:44.785322+0000","last_became_active":"2023-11-19T00:38:43.775203+0000","last_became_peered":"2023-11-19T00:38:43.775203+0000","last_unstale":"2023-11-19T00:38:44.785322+0000","last_undegraded":"2023-11-19T00:38:44.785322+0000","last_fullsized":"2023-11-19T00:38:44.785322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:39:05.146 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-19T00:39:05.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-11-19T00:39:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 19 2023-11-19T00:39:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 8d6e5d21-0548-4be9-97cd-ecd717c3d6dc 2023-11-19T00:39:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:created 2023-11-19T00:38:22.632723+0000 2023-11-19T00:39:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2023-11-19T00:38:45.766733+0000 2023-11-19T00:39:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-11-19T00:39:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:crush_version 4 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:full_ratio 0.95 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:backfillfull_ratio 0.9 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:nearfull_ratio 0.85 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:require_min_compat_client luminous 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:min_compat_client jewel 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:require_osd_release reef 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:stretch_mode_enabled false 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2023-11-19T00:39:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:max_osd 3 2023-11-19T00:39:05.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6800/1937409726,v1:172.21.15.73:6801/1937409726] [v2:172.21.15.73:6802/1937409726,v1:172.21.15.73:6803/1937409726] exists,up ecde3678-8154-4745-bf35-fa177f3451e1 2023-11-19T00:39:05.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/2703344366,v1:172.21.15.99:6801/2703344366] [v2:172.21.15.99:6802/2703344366,v1:172.21.15.99:6803/2703344366] exists,up 5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6 2023-11-19T00:39:05.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/1047303295,v1:172.21.15.181:6801/1047303295] [v2:172.21.15.181:6802/1047303295,v1:172.21.15.181:6803/1047303295] exists,up 8c9f9502-5eda-4cac-9485-b0ac8ea158dd 2023-11-19T00:39:05.486 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6800/1937409726,v1:172.21.15.73:6801/1937409726] [v2:172.21.15.73:6802/1937409726,v1:172.21.15.73:6803/1937409726] exists,up ecde3678-8154-4745-bf35-fa177f3451e1', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/2703344366,v1:172.21.15.99:6801/2703344366] [v2:172.21.15.99:6802/2703344366,v1:172.21.15.99:6803/2703344366] exists,up 5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/1047303295,v1:172.21.15.181:6801/1047303295] [v2:172.21.15.181:6802/1047303295,v1:172.21.15.181:6803/1047303295] exists,up 8c9f9502-5eda-4cac-9485-b0ac8ea158dd'] 2023-11-19T00:39:05.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-11-19T00:39:05.593 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:39:05.593 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mon.a", 2023-11-19T00:39:05.593 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster": "ceph", 2023-11-19T00:39:05.593 INFO:teuthology.orchestra.run.smithi046.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-11-19T00:39:05.593 INFO:teuthology.orchestra.run.smithi046.stdout: "admin_socket_mode": "", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_client_required": "cephx, none", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_cluster_required": "cephx", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_debug": "true", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_service_required": "cephx", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_service_ticket_ttl": "240.000000", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_supported": "cephx", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio": "true", 2023-11-19T00:39:05.594 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio_max_queue_depth": "1024", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio_poll_ms": "250", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio_reap_max": "16", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_async_discard": "false", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_block_size": "4096", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_aio": "false", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_inflight_ios": "false", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_enable_discard": "false", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_flock_retry": "3", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_flock_retry_interval": "0.100000", 2023-11-19T00:39:05.595 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_inject_crash": "0", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_inject_crash_flush_delay": "2", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_ioring": "false", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_ioring_hipri": "false", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_ioring_sqthread_poll": "false", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_read_buffer_alignment": "4096", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_type": "", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_alloc_size": "1048576", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_allocator": "hybrid", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_buffered_io": "true", 2023-11-19T00:39:05.596 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_check_for_zeros": "false", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_check_volume_selector_often": "false", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_compact_log_sync": "false", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_log_compact_min_size": "16777216", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_log_replay_check_allocations": "true", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_max_log_runway": "4194304", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_max_prefetch": "1048576", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_min_flush_size": "524288", 2023-11-19T00:39:05.597 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_min_log_runway": "1048576", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_replay_recovery": "false", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_shared_alloc_size": "65536", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_sync_write": "false", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_allocation_from_file": "true", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_allocator": "hybrid", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-11-19T00:39:05.598 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blobid_prealloc": "10240", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_create": "true", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_db_create": "false", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_db_path": "", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_db_size": "0", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_path": "", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_preallocate_file": "false", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_size": "107374182400", 2023-11-19T00:39:05.599 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_wal_create": "false", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_wal_path": "", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_wal_size": "100663296", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs": "true", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs_env_mirror": "false", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-11-19T00:39:05.600 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_autotune": "true", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_size": "0", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_type": "2q", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-11-19T00:39:05.601 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_clone_cow": "true", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_algorithm": "snappy", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_max_blob_size": "0", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_min_blob_size": "0", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_mode": "none", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_csum_type": "crc32c", 2023-11-19T00:39:05.602 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_enforce_settings": "default", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_freelist": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_fsck_abort": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_inject_read_err": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_legacy_omap": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_prefill": "0.000000", 2023-11-19T00:39:05.603 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_small_allocations": "0", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_default_buffered_read": "true", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_default_buffered_write": "false", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_deferred_batch_ops": "0", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_elastic_shared_blobs": "true", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-11-19T00:39:05.604 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fail_eio": "false", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mkfs": "true", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mount": "false", 2023-11-19T00:39:05.605 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_umount": "false", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_ignore_data_csum": "false", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-11-19T00:39:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_kvbackend": "rocksdb", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_log_op_age": "5.000000", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_alloc_size": "0", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_blob_size": "0", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_defer_interval": "3.000000", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_deferred_txc": "32", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_min_alloc_size": "0", 2023-11-19T00:39:05.607 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_nid_prealloc": "1024", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_prefer_deferred_size": "0", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_qfsck_on_mount": "true", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_retry_disk_reads": "3", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_cf": "true", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2023-11-19T00:39:05.608 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_options_annex": "", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_coremask": "0x1", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_io_sleep": "5", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_max_io_completion": "0", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_mem": "512", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_sync_submit_transaction": "false", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_bytes": "67108864", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_cost_per_io": "0", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-11-19T00:39:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_tracing": "false", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_volume_selection_reserved": "0", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_zero_block_detection": "false", 2023-11-19T00:39:05.610 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_action_update_interval": "2", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_mount_timeout": "10", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-11-19T00:39:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_cluster_require_signatures": "false", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_cluster_require_version": "2", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_require_signatures": "false", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_require_version": "2", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_service_require_signatures": "false", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_service_require_version": "2", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_sign_messages": "true", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "chdir": "", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "client_acl_type": "", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "client_asio_thread_count": "2", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "client_cache_mid": "0.750000", 2023-11-19T00:39:05.612 INFO:teuthology.orchestra.run.smithi046.stdout: "client_cache_size": "16384", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_caps_release_delay": "5", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_check_pool_perm": "true", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_collect_and_send_global_metrics": "false", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_debug_force_sync_read": "false", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_debug_getattr_caps": "false", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_debug_inject_tick_delay": "0", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_die_on_failed_remount": "false", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_dirsize_rbytes": "true", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_force_lazyio": "false", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_fs": "", 2023-11-19T00:39:05.613 INFO:teuthology.orchestra.run.smithi046.stdout: "client_inject_fixed_oldest_tid": "false", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_inject_release_failure": "false", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_max_inline_size": "4096", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_max_retries_on_remount_failure": "5", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mds_namespace": "", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_metadata": "", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mount_gid": "-1", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mount_timeout": "300", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mount_uid": "-1", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mountpoint": "/", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_notify_timeout": "10", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc": "true", 2023-11-19T00:39:05.614 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_max_dirty": "104857600", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_max_dirty_age": "5.000000", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_max_objects": "1000", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_size": "209715200", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_target_dirty": "8388608", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_permissions": "true", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_quota": "true", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_quota_df": "true", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_readahead_max_bytes": "0", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_readahead_max_periods": "4", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_readahead_min": "131072", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_reconnect_stale": "false", 2023-11-19T00:39:05.615 INFO:teuthology.orchestra.run.smithi046.stdout: "client_shutdown_timeout": "30", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "client_snapdir": ".snap", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "client_tick_interval": "1", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "client_trace": "", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "client_try_dentry_invalidate": "false", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "client_use_faked_inos": "false", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "client_use_random_mds": "false", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_graylog": "false", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_graylog_port": "12201", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_monitors": "default=true", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_syslog": "false", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-11-19T00:39:05.616 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_syslog_level": "info", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "-", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_network": "", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_network_interface": "", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zlib_isal": "false", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zlib_level": "5", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zlib_winsize": "-15", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zstd_level": "1", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_alien_op_num_threads": "6", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_alien_thread_cpu_cores": "", 2023-11-19T00:39:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_osd_obc_lru_size": "10", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_seastar_smp": "1", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_location": "", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_location_hook": "", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_location_hook_timeout": "10", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "daemonize": "false", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "daos_pool": "tank", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "dbstore_db_name_prefix": "dbstore", 2023-11-19T00:39:05.618 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_alienstore": "0/5", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_allow_any_pool_priority": "false", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_asok": "1/5", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_asok_assert_abort": "false", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_asserts_on_shutdown": "true", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_auth": "20/20", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_bdev": "1/3", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_bluefs": "1/5", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_bluestore": "1/5", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_buffer": "0/1", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_ceph_exporter": "1/5", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_cephfs_mirror": "0/5", 2023-11-19T00:39:05.619 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_cephsqlite": "0/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_client": "0/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_compressor": "1/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_context": "0/1", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_crimson_interrupt": "0/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_crush": "1/1", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_crypto": "1/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_cyanstore": "0/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_deliberately_leak_memory": "false", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_disable_randomized_ping": "false", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_dpdk": "1/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_eventtrace": "1/5", 2023-11-19T00:39:05.620 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_filer": "0/1", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_filestore": "1/3", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_finisher": "1/1", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_fuse": "1/5", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_heartbeat_testing_span": "0", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_heartbeatmap": "1/5", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_immutable_obj_cache": "0/5", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_javaclient": "1/5", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_journal": "1/3", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_journaler": "0/5", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_kstore": "1/5", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_lockdep": "0/1", 2023-11-19T00:39:05.621 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mclock": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_balancer": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_locker": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_log": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_log_expire": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_migrator": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_memstore": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mgr": "2/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mgrc": "1/5", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mon": "20/20", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_monc": "0/10", 2023-11-19T00:39:05.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_ms": "1/1", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_none": "0/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_objclass": "0/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_objectcacher": "0/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_objecter": "0/1", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_optracker": "0/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_osd": "1/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_paxos": "20/20", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_perfcounter": "1/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_prioritycache": "1/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rados": "0/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd": "0/5", 2023-11-19T00:39:05.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd_mirror": "0/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd_pwl": "0/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd_replay": "0/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_refs": "0/0", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_reserver": "1/1", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw": "1/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_access": "1/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_datacache": "1/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_dbstore": "1/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_flight": "1/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_sync": "1/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rocksdb": "4/5", 2023-11-19T00:39:05.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_backref": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_cache": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_cleaner": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_device": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_epm": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_journal": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_lba": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_odata": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_omap": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_onode": "0/5", 2023-11-19T00:39:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_t": "0/5", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_tm": "0/5", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_striper": "0/1", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_test": "0/5", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_throttle": "1/1", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_timer": "0/1", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_tp": "0/5", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_trace": "1/5", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "defer_client_eviction_on_laggy_osds": "true", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "device_failure_prediction_mode": "none", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-11-19T00:39:05.626 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_graylog": "false", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_journald": "false", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_stderr": "true", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_syslog": "false", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "event_tracing": "false", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_addr": "0.0.0.0", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_http_port": "9926", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_prio_limit": "5", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_sort_metrics": "true", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_stats_period": "5", 2023-11-19T00:39:05.627 INFO:teuthology.orchestra.run.smithi046.stdout: "fake_statfs_for_testing": "0", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "fatal_signal_handlers": "true", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filer_max_purge_ops": "10", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filer_max_truncate_ops": "128", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_apply_finisher_threads": "1", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_blackhole": "false", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_btrfs_clone_range": "true", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_btrfs_snap": "true", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_caller_concurrency": "10", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_collect_device_partition_information": "true", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_commit_timeout": "600.000000", 2023-11-19T00:39:05.628 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_inject_read_err": "false", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_omap_check": "false", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_random_read_err": "0.000000", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_verify_split": "false", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_dump_file": "", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fadvise": "true", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fail_eio": "true", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fd_cache_shards": "16", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fd_cache_size": "128", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fiemap": "false", 2023-11-19T00:39:05.629 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fiemap_threshold": "4096", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_index_retry_probability": "0.000000", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_inject_stall": "0", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_journal_parallel": "false", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_journal_trailing": "false", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_journal_writeahead": "false", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_kill_at": "0", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size": "0", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-11-19T00:39:05.630 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs": "0", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs_other": "2", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_sync_interval": "5.000000", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size": "0", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_merge_threshold": "-10", 2023-11-19T00:39:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_min_sync_interval": "0.010000", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_odsync_write": "false", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_omap_backend": "rocksdb", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_omap_backend_path": "", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_omap_header_cache_size": "1024", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_ondisk_finisher_threads": "1", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_op_thread_timeout": "60", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_op_threads": "2", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_punch_hole": "false", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-11-19T00:39:05.632 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_bytes": "104857600", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_ops": "50", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_seek_data_hole": "false", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_sloppy_crc": "false", 2023-11-19T00:39:05.633 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_splice": "false", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_split_multiple": "2", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_split_rand_factor": "20", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_update_to": "1000", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-11-19T00:39:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_enable": "true", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_xfs_extsize": "false", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_zfs_snap": "false", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "fio_dir": "/tmp/fio", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "fsid": "8d6e5d21-0548-4be9-97cd-ecd717c3d6dc", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_allow_other": "true", 2023-11-19T00:39:05.635 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_atomic_o_trunc": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_big_writes": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_debug": "false", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_default_permissions": "false", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_disable_pagecache": "false", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_max_write": "0", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_multithreaded": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_require_active_mds": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_set_user_groups": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_splice_move": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_splice_read": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_splice_write": "true", 2023-11-19T00:39:05.636 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_syncfs_on_mksnap": "true", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_use_invalidate_cb": "true", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "gss_target_name": "ceph", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_file": "", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_inject_failure": "0", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_interval": "5", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "host": "smithi046", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_max_size": "1073741824", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-11-19T00:39:05.637 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_watermark": "0.900000", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "inject_early_sigterm": "false", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "jaeger_agent_port": "6799", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "jaeger_tracing_enable": "false", 2023-11-19T00:39:05.638 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_aio": "true", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_align_min_size": "65536", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_block_align": "true", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_block_size": "4096", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_dio": "true", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_discard": "false", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_force_aio": "false", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_ignore_corruption": "false", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_max_write_bytes": "10485760", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_max_write_entries": "100", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_replay_from": "0", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_high_multiple": "0.000000", 2023-11-19T00:39:05.639 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_max_multiple": "0.000000", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_write_header_frequency": "0", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_zero_on_create": "false", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "journaler_prefetch_periods": "10", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "journaler_prezero_periods": "5", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "journaler_write_head_interval": "15", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "keyfile": "", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_backend": "rocksdb", 2023-11-19T00:39:05.640 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_default_stripe_size": "65536", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_fsck_on_mount": "false", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_fsck_on_mount_deep": "true", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_max_bytes": "67108864", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_max_ops": "512", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_nid_prealloc": "1024", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_onode_map_size": "1024", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_sync_submit_transaction": "false", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_sync_transaction": "false", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "librados_thread_count": "2", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "lockdep": "false", 2023-11-19T00:39:05.641 INFO:teuthology.orchestra.run.smithi046.stdout: "lockdep_force_backtrace": "false", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_coarse_timestamps": "true", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_flush_on_exit": "false", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_graylog_host": "127.0.0.1", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_graylog_port": "12201", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_max_new": "1000", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_max_recent": "10000", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_stderr_prefix": "", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_stop_at_utilization": "0.970000", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": "true", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_graylog": "false", 2023-11-19T00:39:05.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_journald": "false", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_stderr": "false", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_syslog": "false", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mandatory_topic_permissions": "false", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "max_rotating_auth_attempts": "10", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_action_on_write_error": "1", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_alternate_name_max": "8192", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_asio_thread_count": "2", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_export_pin": "true", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_dirs": "true", 2023-11-19T00:39:05.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_interval": "5", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_size_max": "100000", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_idle_threshold": "0.000000", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_interval": "10", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_max": "-1", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_max_until": "-1", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_merge_size": "50", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_midchunk": "0.300000", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_min_rebalance": "0.100000", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_min_start": "0.200000", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_minchunk": "0.001000", 2023-11-19T00:39:05.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_mode": "0", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_need_max": "1.200000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_need_min": "0.800000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_overload_epochs": "2", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_sample_interval": "3.000000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_bits": "3", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_rd": "25000.000000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_size": "10000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_wr": "10000.000000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_target_decay": "10.000000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-11-19T00:39:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_beacon_grace": "15.000000", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_beacon_interval": "4.000000", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_beacon_mon_down_grace": "60", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_memory_limit": "4294967296", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_mid": "0.700000", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_release_free_interval": "10", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_reservation": "0.050000", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_trim_interval": "1", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_trim_threshold": "262144", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-11-19T00:39:05.646 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_client_delegate_inos_pct": "50", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_client_prealloc_inos": "1000", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_connect_bootstrapping": "false", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_damage_table_max_entries": "10000", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_auth_pins": "false", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_frag": "false", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_scatterstat": "false", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_subtrees": "false", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_decay_halflife": "5.000000", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_default_dir_hash": "2", 2023-11-19T00:39:05.647 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_defer_session_stale": "true", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_deny_all_reconnect": "false", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_keys_per_op": "16384", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_max_commit_size": "10", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_max_entries": "0", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_prefetch": "true", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dirstat_min_interval": "1.000000", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_after_rejoin": "false", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_on_map": "false", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_threshold_file": "0", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_early_reply": "true", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_enable_op_tracker": "true", 2023-11-19T00:39:05.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_enforce_unique_name": "true", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_distributed": "true", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_random": "true", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_forward_all_requests_to_auth": "false", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_go_bad_corrupt_dentry": "true", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_health_cache_threshold": "1.500000", 2023-11-19T00:39:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_health_summarize_threshold": "10", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_heartbeat_grace": "15.000000", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_heartbeat_reset_grace": "1000", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_health_dummy": "false", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_migrator_session_race": "false", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_skip_replaying_inotable": "false", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_join_fs": "", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_journal_format": "1", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_create_at": "0", 2023-11-19T00:39:05.650 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_export_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_import_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_journal_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_journal_expire_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_journal_replay_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_link_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_mdstable_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_openc_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_rename_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_shutdown_at": "0", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_skip_replaying_inotable": "false", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_event_large_threshold": "524288", 2023-11-19T00:39:05.651 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_events_per_segment": "1024", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_major_segment_event_ratio": "12", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_max_events": "-1", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_max_segments": "128", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_pause": "false", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_segment_size": "0", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_skip_corrupt_events": "false", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_skip_unbounded_events": "false", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_warn_factor": "2.000000", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_caps_per_client": "1048576", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_completed_flushes": "100000", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_completed_requests": "100000", 2023-11-19T00:39:05.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_export_size": "20971520", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_file_recover": "32", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_purge_files": "64", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_purge_ops": "8192", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_snaps_per_dir": "100", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_metrics_update_interval": "2", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_min_caps_per_client": "100", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_min_caps_working_set": "10000", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_numa_node": "-1", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-11-19T00:39:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_complaint_time": "30.000000", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_duration": "600", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_size": "20", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_slow_op_size": "20", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_slow_op_threshold": "10", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_log_threshold": "5", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_ping_grace": "15", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_ping_interval": "5", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_max_caps": "30000", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-11-19T00:39:05.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_max_decay_threshold": "131072", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_warning_threshold": "262144", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_reconnect_timeout": "45.000000", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_replay_interval": "1.000000", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_root_ino_gid": "0", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_root_ino_uid": "0", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_blocklist_on_evict": "true", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_blocklist_on_timeout": "true", 2023-11-19T00:39:05.655 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cap_acquisition_throttle": "100000", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_metadata_threshold": "16777216", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_shutdown_check": "0", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_skip_ino": "0", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sleep_rank_change": "0.000000", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_snap_max_uid": "4294967294", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_snap_min_uid": "0", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_snap_rstat": "false", 2023-11-19T00:39:05.656 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_standby_replay_damaged": "false", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_symlink_recovery": "true", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_task_status_update_interval": "2.000000", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_thrash_exports": "0", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_thrash_fragments": "0", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_tick_interval": "5.000000", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_valgrind_exit": "false", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_verify_backtrace": "1", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_verify_scatter": "false", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_wipe_ino_prealloc": "false", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_wipe_sessions": "false", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool_debug": "false", 2023-11-19T00:39:05.657 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_debug_omit_block_device_write": "false", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_device_bytes": "1073741824", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_page_set": "false", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_page_size": "65536", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_client_bytes": "134217728", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_client_messages": "512", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_connect_retry_interval": "1.000000", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_disabled_modules": "", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-11-19T00:39:05.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_max_pg_num_change": "128", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mds_bytes": "134217728", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mds_messages": "128", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mon_bytes": "134217728", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mon_messages": "128", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_osd_bytes": "536870912", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_osd_messages": "8192", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_pool": "true", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_service_beacon_grace": "60.000000", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_standby_modules": "true", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_stats_period": "5", 2023-11-19T00:39:05.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_stats_threshold": "5", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_tick_period": "2", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_accept_timeout_factor": "2.000000", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_allow_pool_delete": "true", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_allow_pool_size_one": "true", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_auth_validate_all_caps": "true", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_bytes": "104857600", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_directed_command_retry": "2", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval": "3.000000", 2023-11-19T00:39:05.660 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_parallel": "3", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_log_interval": "1.000000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_ping_interval": "10.000000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_ping_timeout": "30.000000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_target_rank": "-1", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_clock_drift_allowed": "1.000000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-11-19T00:39:05.661 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_file_level": "debug", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_file": "true", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_graylog": "false", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_journald": "false", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_stderr": "false", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_compact_on_bootstrap": "false", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_compact_on_start": "false", 2023-11-19T00:39:05.662 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_compact_on_trim": "true", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_con_tracker_persist_interval": "10", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_con_tracker_score_halflife": "43200", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_config_key_max_entry_size": "65536", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cpu_threads": "4", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_crush_min_required_version": "hammer", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_daemon_bytes": "419430400", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data_avail_crit": "5", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data_avail_warn": "5", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data_size_warn": "16106127360", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_block_osdmap_trim": "false", 2023-11-19T00:39:05.663 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_dump_json": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_dump_transactions": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_extra_checks": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_require_quincy": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_require_reef": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_delta_reset_interval": "10.000000", 2023-11-19T00:39:05.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_dns_srv_name": "ceph-mon", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_down_mkfs_grace": "120", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_election_default_strategy": "1", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_election_timeout": "5.000000", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_elector_ping_divisor": "2", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_elector_ping_timeout": "2.000000", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_enable_op_tracker": "true", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_fake_pool_delete": "false", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_force_quorum_join": "false", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_globalid_prealloc": "10000", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_detail_to_clog": "false", 2023-11-19T00:39:05.665 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_log_update_period": "5", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_max_detail": "50", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_to_clog": "true", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_to_clog_interval": "600", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_host": "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_host_override": "", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_initial_members": "", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-11-19T00:39:05.666 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_keyvaluedb": "rocksdb", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_lease": "5.000000", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_log_full_interval": "50", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_log_max": "10000", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_log_max_summary": "50", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_log_entries_per_event": "4096", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_log_epochs": "500", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_mdsmap_epochs": "500", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_mgrmap_epochs": "500", 2023-11-19T00:39:05.667 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_osd": "10000", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_pg_per_osd": "10000", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_pool_pg_num": "65536", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mds_force_trim_to": "0", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mds_skip_sanity": "false", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_memory_autotune": "true", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_memory_target": "2147483648", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_beacon_grace": "30", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_digest_period": "5", 2023-11-19T00:39:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_inactive_grace": "60", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_mkfs_grace": "240", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_min_osdmap_epochs": "500", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_complaint_time": "30", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_duration": "600", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_size": "20", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_slow_op_size": "20", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_slow_op_threshold": "10", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_log_threshold": "5", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-11-19T00:39:05.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_auto_mark_in": "false", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_auto_mark_new_in": "true", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_cache_size": "500", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_cache_size_min": "134217728", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_crush_smoke_test": "true", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_destroyed_out_interval": "600", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_down_out_interval": "600", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-11-19T00:39:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_force_trim_to": "0", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_full_ratio": "0.950000", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_laggy_halflife": "3600", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_laggy_max_interval": "300", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_laggy_weight": "0.300000", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_max_creating_pgs": "1024", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_max_initial_pgs": "1024", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_min_down_reporters": "2", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-11-19T00:39:05.671 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_prime_pg_temp": "true", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_report_timeout": "900", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_warn_num_repaired": "10", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_warn_op_age": "32.000000", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_interval": "10", 2023-11-19T00:39:05.672 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_min": "10000", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_stuck_threshold": "60", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_min_objects": "10000", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_min_per_osd": "0", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pool_quota_crit_threshold": "0", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pool_quota_warn_threshold": "0", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_probe_timeout": "2.000000", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_max_change": "0.050000", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_max_osds": "4", 2023-11-19T00:39:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_interval": "86400", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_max_keys": "100", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_timeout": "300", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_session_timeout": "300", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_smart_report_timeout": "5", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stat_smooth_intervals": "6", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-11-19T00:39:05.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_pool_min_size": "2", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_pool_size": "4", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_subscribe_interval": "86400.000000", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_debug": "false", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_max_payload_keys": "2000", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_max_payload_size": "1048576", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_provider_kill_at": "0", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_requester_kill_at": "0", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_timeout": "60.000000", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_target_pg_per_osd": "100", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_tick_interval": "5", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_timecheck_interval": "300.000000", 2023-11-19T00:39:05.675 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_use_min_delay_socket": "false", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_older_version_delay": "604800", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_filestore_osds": "false", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_misplaced": "false", 2023-11-19T00:39:05.676 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_older_version": "true", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_pool_no_app": "true", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_too_few_osds": "false", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "monmap": "", 2023-11-19T00:39:05.677 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_tracing_enabled": "false", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_op_threads": "3", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_buffer_size": "131072", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_cm": "false", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_device_name": "", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_dscp": "96", 2023-11-19T00:39:05.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_gid_idx": "0", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_local_gid": "", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_polling_us": "1000", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_port_num": "1", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_roce_ver": "1", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_send_buffers": "1024", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_sl": "3", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_support_srq": "true", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_type": "ib", 2023-11-19T00:39:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_reap_threshold": "5", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_before_connect": "false", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_ipv4": "true", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_ipv6": "false", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_msgr1": "true", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_msgr2": "true", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_port_max": "7568", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_port_min": "6800", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_prefer_ipv4": "false", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_retry_count": "3", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_retry_delay": "5", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_client": "false", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_mds": "false", 2023-11-19T00:39:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_mgr": "false", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_mon": "false", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_osd": "false", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_client_mode": "crc secure", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_cluster_mode": "crc secure", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_cluster_type": "", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_compress_secure": "false", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_connection_idle_timeout": "900", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_connection_ready_timeout": "10", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_crc_data": "true", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_crc_header": "true", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_bad_msg": "false", 2023-11-19T00:39:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_bug": "true", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_old_message": "true", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_skipped_message": "false", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_unhandled_msg": "false", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_coremask": "0xF", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_devs_allowlist": "", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_enable_tso": "true", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_hugepages": "", 2023-11-19T00:39:05.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_hw_flow_control": "true", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_lro": "true", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_memory_channel": "4", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_pmd": "", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_port_id": "0", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dump_corrupt_message_level": "1", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dump_on_send": "false", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_initial_backoff": "0.200000", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_delay_max": "1.000000", 2023-11-19T00:39:05.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_delay_probability": "0.000000", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_delay_type": "", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_internal_delays": "0.000000", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_network_congestion": "0", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_socket_failures": "0", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_learn_addr_from_peer": "true", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_max_accept_failures": "4", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_max_backoff": "15.000000", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_mon_client_mode": "secure crc", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_mon_cluster_mode": "secure crc", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_mon_service_mode": "secure crc", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_osd_compress_min_size": "1024", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_osd_compress_mode": "none", 2023-11-19T00:39:05.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_osd_compression_algorithm": "snappy", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_pq_min_cost": "65536", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_public_type": "", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_service_mode": "crc secure", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_listen_backlog": "512", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_nodelay": "true", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_rcvbuf": "0", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_type": "async+posix", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "no_config_file": "false", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_completion_locks_per_session": "32", 2023-11-19T00:39:05.685 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_debug_inject_relock_delay": "false", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_inflight_op_bytes": "104857600", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_inflight_ops": "1024", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_inject_no_watch_ping": "false", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_tick_interval": "5.000000", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_timeout": "10.000000", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "objectstore_blackhole": "false", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "openssl_engine_opts": "", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_delay_time": "5.000000", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_hist_halflife": "1000", 2023-11-19T00:39:05.686 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_max_low_ops": "2", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_max_ops": "4", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_quantize_effort": "0.100000", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_slop": "0.020000", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_allow_recovery_below_min_size": "true", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_asio_thread_count": "2", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_async_recovery_min_cost": "100", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_auto_mark_unfound_lost": "false", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backfill_retry_interval": "30.000000", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backfill_scan_max": "512", 2023-11-19T00:39:05.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backfill_scan_min": "64", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backoff_on_degraded": "false", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backoff_on_peering": "false", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backoff_on_unfound": "true", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_beacon_report_interval": "300", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_duration": "30", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_max_block_size": "67108864", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_small_size_max_iops": "100", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_blkin_trace_all": "false", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_blocked_scrub_grace_period": "120", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-11-19T00:39:05.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_check_for_log_corruption": "false", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_update_on_start": "true", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_message_cap": "256", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_message_size_cap": "524288000", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_op_priority": "63", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_watch_timeout": "30", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_command_max_records": "256", 2023-11-19T00:39:05.689 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_compact_on_start": "false", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_chooseleaf_type": "0", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_initial_weight": "-1.000000", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_update_on_start": "true", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_update_weight_set": "true", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_drop_ping_duration": "0", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_feed_pullee": "-1", 2023-11-19T00:39:05.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_misdirected_ops": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_no_acting_change": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_no_purge_strays": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_op_order": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_pg_log_writeout": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_pretend_recovery_active": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_shutdown": "false", 2023-11-19T00:39:05.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_trim_objects": "false", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_cached_snaps": "false", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_missing_on_start": "false", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_snaps": "false", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_keys": "1024", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-11-19T00:39:05.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_stride": "524288", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_default_data_pool_replay_window": "5", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_default_notify_timeout": "30", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep": "0.000000", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_discard_disconnected_ops": "true", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_enable_op_tracker": "true", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_extblkdev_plugins": "vdo", 2023-11-19T00:39:05.693 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_info": "true", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_shutdown": "true", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_shutdown_timeout": "15", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_function_tracing": "false", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_grace": "20", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_interval": "6", 2023-11-19T00:39:05.694 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_min_peers": "10", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_min_size": "2000", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_stale": "600", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_hit_set_max_size": "100000", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_hit_set_min_size": "1000", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-11-19T00:39:05.695 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_journal_flush_on_shutdown": "true", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_journal_size": "5120", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_kill_backfill_at": "0", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_loop_before_reset_tphandle": "64", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_cache_size": "50", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_dedup": "true", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_message_max": "40", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_message_max_bytes": "10485760", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_share_max_epochs": "40", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_attr_name_len": "100", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_attr_size": "0", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_backfills": "1", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_markdown_count": "5", 2023-11-19T00:39:05.696 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_markdown_period": "600", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_object_name_len": "2048", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_object_namespace_len": "256", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_object_size": "134217728", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_omap_entries_per_request": "1024", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pg_blocked_by": "16", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pg_log_entries": "10000", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pgls": "1024", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_push_cost": "8388608", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_push_objects": "10", 2023-11-19T00:39:05.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_scrubs": "3", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_trimming_pgs": "2", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_write_op_reply_len": "64", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_write_size": "90", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2023-11-19T00:39:05.698 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_override_recovery_settings": "false", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_profile": "balanced", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-11-19T00:39:05.699 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_skip_benchmark": "false", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_base": "805306368", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_cache_min": "134217728", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_target": "4294967296", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_target_autotune": "false", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_min_pg_log_entries": "250", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_min_recovery_priority": "0", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_heartbeat_interval": "30", 2023-11-19T00:39:05.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_report_interval": "5", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_report_max_in_flight": "2", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_num_cache_shards": "32", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_num_op_tracker_shard": "32", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_numa_auto_affinity": "true", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_numa_node": "-1", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_numa_prefer_iface": "true", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objecter_finishers": "1", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objectstore": "bluestore", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objectstore_fuse": "false", 2023-11-19T00:39:05.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objectstore_tracing": "false", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_complaint_time": "30.000000", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_duration": "600", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_size": "20", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_slow_op_size": "20", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_log_threshold": "5", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_shards": "0", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_shards_hdd": "5", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_shards_ssd": "8", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_threads_per_shard": "0", 2023-11-19T00:39:05.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_pq_min_cost": "65536", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_queue": "mclock_scheduler", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_queue_cut_off": "high", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_thread_suicide_timeout": "150", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_thread_timeout": "15", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_open_classes_on_start": "true", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_os_flags": "0", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_peering_op_priority": "255", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_delete_cost": "1048576", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_delete_priority": "5", 2023-11-19T00:39:05.703 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_log_dups_tracked": "3000", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_log_trim_max": "10000", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_log_trim_min": "100", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_object_context_cache_count": "64", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_stat_report_interval_max": "500", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-11-19T00:39:05.704 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_crimson": "false", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_crush_rule": "-1", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_ec_fast_read": "false", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_bulk": "false", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_nodelete": "false", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flags": "0", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-11-19T00:39:05.705 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_min_size": "0", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_pg_num": "32", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_pgp_num": "0", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_size": "2", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_type": "replicated", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_use_gmt_hitset": "true", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_push_per_object_cost": "1000", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_read_ec_check_for_errors": "false", 2023-11-19T00:39:05.706 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recover_clone_overlap": "true", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recover_clone_overlap_limit": "10", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_cost": "20971520", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_delay_start": "0.000000", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_active": "0", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_active_hdd": "3", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_active_ssd": "10", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_chunk": "8388608", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_single_start": "1", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_op_priority": "3", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_op_warn_multiple": "16", 2023-11-19T00:39:05.707 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_priority": "5", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_retry_interval": "30.000000", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep": "0.000000", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_repair_during_recovery": "false", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_requested_scrub_priority": "120", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_rollback_to_cluster_snap": "", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_auto_repair": "false", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-11-19T00:39:05.708 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_begin_hour": "0", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_begin_week_day": "0", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_chunk_max": "25", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_chunk_min": "5", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_cost": "52428800", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_during_recovery": "false", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_end_hour": "0", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_end_week_day": "0", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_event_cost": "4096", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_invalid_stats": "true", 2023-11-19T00:39:05.709 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_load_threshold": "0.500000", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_max_interval": "604800.000000", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_max_preemptions": "5", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_min_interval": "86400.000000", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_priority": "5", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_reservation_timeout": "300000", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_sleep": "0.000000", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_slow_reservation_response": "30000", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_shallow_scrub_chunk_max": "100", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_shallow_scrub_chunk_min": "50", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_shutdown_pgref_assert": "false", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_skip_data_digest": "false", 2023-11-19T00:39:05.710 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_smart_report_timeout": "5", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_cost": "1048576", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_priority": "5", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep": "0.000000", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_stats_update_period_not_scrubbing": "120", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_stats_update_period_scrubbing": "15", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_target_transaction_size": "30", 2023-11-19T00:39:05.711 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_mode": "writeback", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tracing": "false", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_use_stale_snap": "false", 2023-11-19T00:39:05.712 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "osdc_blkin_trace_all": "false", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_kill_at": "0", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_max_join_drift": "10", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_min": "500", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_min_wait": "0.050000", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_propose_interval": "1.000000", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_service_trim_max": "500", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_service_trim_max_multiplier": "20", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_service_trim_min": "250", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_stash_full_interval": "25", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_trim_max": "500", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_trim_min": "250", 2023-11-19T00:39:05.713 INFO:teuthology.orchestra.run.smithi046.stdout: "perf": "true", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "-", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrv": "", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "public_bind_addr": "-", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "public_network": "", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "public_network_interface": "", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "qat_compressor_enabled": "false", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "qat_compressor_session_max_number": "256", 2023-11-19T00:39:05.714 INFO:teuthology.orchestra.run.smithi046.stdout: "rados_mon_op_timeout": "0", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rados_osd_op_timeout": "0", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rados_tracing": "false", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_atime_update_interval": "60", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_balance_parent_reads": "false", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_balance_snap_reads": "false", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_blkin_trace_all": "false", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_blocklist_expire_seconds": "0", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_blocklist_on_break_lock": "true", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache": "true", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_block_writes_upfront": "false", 2023-11-19T00:39:05.715 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_max_dirty": "25165824", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_max_dirty_object": "0", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_policy": "writearound", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_size": "33554432", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_target_dirty": "16777216", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_clone_copy_on_read": "false", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_compression_hint": "none", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_concurrent_management_ops": "10", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_clone_format": "auto", 2023-11-19T00:39:05.716 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_data_pool": "", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_features": "61", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_format": "2", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_map_options": "", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_order": "22", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_pool": "rbd", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_stripe_count": "0", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_stripe_unit": "0", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_disable_zero_copy_writes": "true", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_discard_granularity_bytes": "65536", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-11-19T00:39:05.717 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_enable_alloc_hint": "true", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_io_scheduler": "simple", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_commit_age": "5.000000", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_flush_interval": "0", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-11-19T00:39:05.718 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_order": "24", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_pool": "", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_splay_width": "4", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_localize_parent_reads": "false", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_localize_snap_reads": "false", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-11-19T00:39:05.719 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_type": "simple", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_autotune": "true", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_base": "805306368", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-11-19T00:39:05.720 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_target": "4294967296", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_delete_delay": "0", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_replay_delay": "0", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_move_to_trash_on_remove": "false", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-11-19T00:39:05.721 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mtime_update_interval": "60", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_non_blocking_aio": "true", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_op_thread_timeout": "60", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_op_threads": "1", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_parent_cache_enabled": "false", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_persistent_cache_mode": "disabled", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_persistent_cache_path": "/tmp", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_persistent_cache_size": "1073741824", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_plugins": "", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_bps_burst": "0", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-11-19T00:39:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_bps_limit": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_exclude_ops": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_iops_burst": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_iops_limit": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_bps_burst": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_bps_limit": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_iops_burst": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_iops_limit": "0", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_schedule_tick_min": "50", 2023-11-19T00:39:05.723 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_bps_burst": "0", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_bps_limit": "0", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_iops_burst": "0", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_iops_limit": "0", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_quiesce_notification_attempts": "10", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_read_from_replica_policy": "default", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_readahead_max_bytes": "524288", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_readahead_trigger_requests": "10", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_request_timed_out_seconds": "30", 2023-11-19T00:39:05.724 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_skip_partial_discard": "true", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_tracing": "false", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_validate_names": "true", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_validate_pool": "true", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "restapi_base_url": "", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "restapi_log_level": "", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_acl_grants_max_num": "100", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_admin_entry": "admin", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_backend_store": "rados", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_barbican_url": "", 2023-11-19T00:39:05.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_beast_enable_async": "true", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_counters_cache": "false", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_counters_cache_size": "10000", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_index_max_aio": "128", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_quota_ttl": "600", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_sync_spawn_window": "20", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cache_enabled": "true", 2023-11-19T00:39:05.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cache_expiry_interval": "900", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cache_lru_size": "10000", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_config_store": "rados", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_content_length_compat": "false", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_copy_obj_progress": "true", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cors_rules_max_num": "100", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cross_domain_policy": "", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_default_encryption_key": "", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_addr": "", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_ca_path": "", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_client_cert": "", 2023-11-19T00:39:05.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_client_key": "", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_password": "", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_username": "", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_require_ssl": "true", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_backend": "vault", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2023-11-19T00:39:05.728 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_suppress_logs": "true", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_addr": "", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_auth": "token", 2023-11-19T00:39:05.729 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_namespace": "", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_prefix": "", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_token_file": "", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_buffersize": "524288", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_low_speed_limit": "1024", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_low_speed_time": "300", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_tcp_keepalive": "0", 2023-11-19T00:39:05.730 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_fadvise": "4", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_libaio_aio_num": "64", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_libaio_aio_threads": "20", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d4n_host": "127.0.0.1", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d4n_port": "6379", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-11-19T00:39:05.731 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_changes_size": "1000", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_num_shards": "128", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_window": "30", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_notify_interval_msec": "0", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_sync_poll_interval": "20", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_sync_spawn_window": "20", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_debug_inject_set_olh_err": "0", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_data_log_backing": "fifo", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_region_info_oid": "default.region", 2023-11-19T00:39:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_defer_to_bucket_acls": "", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_data_res": "500.000000", 2023-11-19T00:39:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dns_name": "", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dns_s3website_name": "", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dynamic_resharding": "true", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_gc_threads": "true", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_lc_threads": "true", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_ops_log": "false", 2023-11-19T00:39:05.734 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_quota_threads": "true", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_static_website": "false", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_usage_log": "false", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enforce_swift_acls": "true", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_exit_timeout_secs": "120", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_expose_bucket": "false", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_extended_http_attrs": "", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_filter": "none", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_frontends": "beast port=7480", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_concurrent_io": "10", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_deferred": "50", 2023-11-19T00:39:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_objs": "32", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_queue_size": "134213632", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_trim_chunk": "16", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_obj_min_wait": "7200", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_processor_max_time": "3600", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_processor_period": "3600", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_get_obj_window_size": "16777216", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_healthcheck_disabling_path": "", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ignore_get_invalid_range": "false", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_init_timeout": "300", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-11-19T00:39:05.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_accepted_reader_roles": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_domain": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_password": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_password_path": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_project": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_tenant": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_token": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_token_path": "", 2023-11-19T00:39:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_user": "", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_api_version": "2", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_domain": "", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_password": "", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_project": "", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_tenant": "", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_user": "", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_implicit_tenants": "false", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_service_token_enabled": "false", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_token_cache_size": "10000", 2023-11-19T00:39:05.738 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_url": "", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_verify_ssl": "true", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_debug_interval": "-1", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_lock_max_time": "90", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_objs": "32", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_rules": "1000", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_worker": "3", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_wp_worker": "3", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_thread_delay": "0", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_dnattr": "uid", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-11-19T00:39:05.739 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_searchfilter": "", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_uri": "ldaps://", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_http_headers": "", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_nonexistent_bucket": "false", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_object_name_utc": "false", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lua_max_memory_per_state": "128000", 2023-11-19T00:39:05.740 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_attr_name_len": "0", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_attr_size": "0", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_attrs_num_in_req": "0", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_chunk_size": "4194304", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_concurrent_requests": "1024", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_dynamic_shards": "1999", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_listing_results": "1000", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_notify_retries": "10", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_objs_per_shard": "100000", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_put_param_size": "1048576", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_put_size": "5368709120", 2023-11-19T00:39:05.741 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_slo_entries": "1000", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_md_log_max_shards": "64", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_md_notify_interval_msec": "200", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_meta_sync_poll_interval": "20", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_meta_sync_spawn_window": "20", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_mp_lock_max_time": "600", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_multi_obj_del_max_aio": "16", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_multipart_min_part_size": "5242880", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_fhcache_size": "2017", 2023-11-19T00:39:05.742 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_frontends": "rgw-nfs", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_lru_lanes": "5", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_max_gc": "300", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_gc_threads": "false", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_lc_threads": "false", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_quota_threads": "false", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_sync_thread": "false", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_num_async_rados_threads": "32", 2023-11-19T00:39:05.743 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_num_control_oids": "8", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_numa_node": "-1", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_obj_stripe_size": "4194304", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_objexp_chunk_size": "100", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_objexp_gc_interval": "600", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_objexp_hints_num_shards": "127", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_op_thread_timeout": "600", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_op_tracing": "false", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_opa_token": "", 2023-11-19T00:39:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_opa_url": "", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_opa_verify_ssl": "true", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_rados": "false", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_socket_path": "", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_push_interval": "2.000000", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_push_interval_max": "30.000000", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_root_pool": ".rgw.root", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_policy_reject_invalid_principals": "true", 2023-11-19T00:39:05.745 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_posix_cache_lanes": "3", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_posix_cache_lmdb_count": "3", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_posix_cache_max_buckets": "100", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_posix_cache_partitions": "3", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_print_continue": "true", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_print_prohibited_content_length": "false", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-11-19T00:39:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rados_tracing": "false", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_realm": "", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_realm_id": "", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_region": "", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_region_root_pool": ".rgw.root", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_relaxed_region_enforcement": "false", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_request_uri": "", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_batch_size": "64", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-11-19T00:39:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_max_aio": "128", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_num_logs": "16", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_thread_interval": "600", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_resolve_cname": "false", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rest_getusage_op_compat": "false", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_run_sync_thread": "true", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_keystone": "false", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_ldap": "false", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_rados": "true", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_sts": "false", 2023-11-19T00:39:05.748 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_client_max_sig_ver": "-1", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_success_create_obj_status": "0", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_scheduler_type": "throttler", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_script_uri": "", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_service_provider_name": "", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_client_id": "", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_client_secret": "", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_entry": "sts", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_key": "sts", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_max_session_duration": "43200", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_min_session_duration": "900", 2023-11-19T00:39:05.749 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_token_introspection_url": "", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_account_in_url": "false", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_auth_entry": "auth", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_auth_url": "", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_custom_header": "", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_enforce_content_length": "false", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_need_stats": "true", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_tenant_name": "", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_token_expiration": "86400", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_url": "", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_url_prefix": "swift", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_versioning_enabled": "false", 2023-11-19T00:39:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_lease_period": "120", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_interval": "1200", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_obj_etag_verify": "false", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_trace_history_size": "4096", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-11-19T00:39:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_thread_pool_size": "512", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_topic_persistency_max_retries": "0", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_topic_persistency_sleep_duration": "0", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_topic_persistency_time_to_live": "0", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_comment": "", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_createby": "", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_encoding": "", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_flag": "false", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_max_size": "5368709120", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_origin": "", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_sha_unit": "524288", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_tracker": "", 2023-11-19T00:39:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_trust_forwarded_https": "false", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_log_tick_interval": "30", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_max_shards": "32", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_max_user_shards": "1", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_use_opa_authz": "false", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_counters_cache": "false", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_counters_cache_size": "10000", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_default_quota_max_size": "-1", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_max_buckets": "1000", 2023-11-19T00:39:05.753 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_policies_max_num": "100", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_sync_interval": "86400", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_unique_email": "true", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_verify_ssl": "true", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_website_routing_rules_max_num": "50", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zone": "", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zone_id": "", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-11-19T00:39:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zonegroup": "", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zonegroup_id": "", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rgwlc_auto_session_clear": "true", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rgwlc_skip_bucket_step": "false", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_block_size": "4096", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_shard_bits": "4", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_size": "536870912", 2023-11-19T00:39:05.755 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_type": "binned_lru", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cf_compact_on_deletion": "true", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_collect_compaction_stats": "false", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_collect_extended_stats": "false", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_collect_memory_stats": "false", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_index_type": "binary_search", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_log_to_ceph_log": "true", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_metadata_block_size": "4096", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_partition_filters": "false", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_perf": "false", 2023-11-19T00:39:05.756 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "rotating_keys_renewal_timeout": "10", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "run_dir": "/var/run/ceph", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_block_create": "true", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_cache_lru_size": "67108864", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_cbjournal_size": "5368709120", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_data_delta_based_overwrite": "0", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_default_max_object_size": "16777216", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_default_object_metadata_reservation": "16777216", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_device_size": "53687091200", 2023-11-19T00:39:05.757 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_batch_capacity": "16", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_batch_flush_size": "16777216", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_iodepth_limit": "5", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_main_device_type": "SSD", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_max_concurrent_transactions": "8", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_obj_data_write_amplification": "1.250000", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_segment_size": "67108864", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "set_keepcaps": "false", 2023-11-19T00:39:05.758 INFO:teuthology.orchestra.run.smithi046.stdout: "setgroup": "", 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout: "setuser": "", 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout: "setuser_match_path": "", 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_misplaced_ratio": "0.050000", 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout: "thp": "false", 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout: "threadpool_default_timeout": "60", 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout: "threadpool_empty_queue_max_wait": "2", 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout: "throttler_perf_counter": "true" 2023-11-19T00:39:05.759 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:39:05.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-11-19T00:39:05.881 INFO:teuthology.orchestra.run.smithi046.stdout:mon.a: {} 2023-11-19T00:39:05.882 INFO:teuthology.orchestra.run.smithi046.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2023-11-19T00:39:05.890 INFO:teuthology.orchestra.run.smithi046.stdout:mon.b: {} 2023-11-19T00:39:05.890 INFO:teuthology.orchestra.run.smithi046.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2023-11-19T00:39:05.899 INFO:teuthology.orchestra.run.smithi046.stdout:mon.c: {} 2023-11-19T00:39:05.899 INFO:teuthology.orchestra.run.smithi046.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2023-11-19T00:39:05.910 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2023-11-19T00:39:05.910 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-19T00:39:05.934 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-19T00:39:05.935 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-11-19T00:39:05.935 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-19T00:39:05.935 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-19T00:39:05.935 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:05.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:05.935 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-11-19T00:39:05.936 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-11-19T00:39:05.936 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:05.936 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:05.936 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-11-19T00:39:05.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-11-19T00:39:05.937 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-11-19T00:39:05.938 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-11-19T00:39:05.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:05.938 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-11-19T00:39:05.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:05.939 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-11-19T00:39:05.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:39:05.940 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:05.938+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:05.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:05.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-11-19T00:39:06.029 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-11-19T00:39:06.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:39:06.031 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-19T00:39:06.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-19T00:39:06.039 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:06.039+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:06.056 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:06.056 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:06.056 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:06.056 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:06.065 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:06.075 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:06.100 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:06.101 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:06.119 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:06.120 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:06.141 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:06.140+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:06.211 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:06.211 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:06.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:06.242 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:06.241+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:06.250 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:06.250 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:39:06.250 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 19, 2023-11-19T00:39:06.250 INFO:teuthology.orchestra.run.smithi046.stdout: "fsid": "8d6e5d21-0548-4be9-97cd-ecd717c3d6dc", 2023-11-19T00:39:06.250 INFO:teuthology.orchestra.run.smithi046.stdout: "created": "2023-11-19T00:38:22.632723+0000", 2023-11-19T00:39:06.250 INFO:teuthology.orchestra.run.smithi046.stdout: "modified": "2023-11-19T00:38:45.766733+0000", 2023-11-19T00:39:06.250 INFO:teuthology.orchestra.run.smithi046.stdout: "last_up_change": "2023-11-19T00:38:32.614375+0000", 2023-11-19T00:39:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: "last_in_change": "2023-11-19T00:38:23.684697+0000", 2023-11-19T00:39:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-11-19T00:39:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_num": 5799936, 2023-11-19T00:39:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_set": [ 2023-11-19T00:39:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: "pglog_hardlimit", 2023-11-19T00:39:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: "purged_snapdirs", 2023-11-19T00:39:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_deletes", 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "sortbitwise" 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_version": 4, 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "full_ratio": 0.94999998807907104, 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "nearfull_ratio": 0.85000002384185791, 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_snapshot": "", 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_max": 4, 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd": 3, 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "require_min_compat_client": "luminous", 2023-11-19T00:39:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: "min_compat_client": "jewel", 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "require_osd_release": "reef", 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_crimson": false, 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": [ 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 1, 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": ".mgr", 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:33.077694+0000", 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:06.253 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:06.254 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 1, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 1, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 1, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 1, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 1, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:06.255 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "12", 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:06.256 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:06.257 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:06.258 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_max": 32, 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 1 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": {} 2023-11-19T00:39:06.259 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 2.9900000095367432, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 2.9900000095367432, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 2, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 2, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.260 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 2, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "rbd", 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:37.909259+0000", 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 8, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 8, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 8, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 8, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 8, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:06.262 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "15", 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:06.263 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:06.264 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:06.265 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "options": {}, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd": {} 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.266 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.5, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.5, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 1, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.5, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.5, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 3, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_metadata", 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:42.590087+0000", 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:06.268 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 32, 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 32, 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 32, 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 32, 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 32, 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:06.269 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:06.270 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:06.270 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:06.270 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:06.270 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:06.270 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:06.271 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.271 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "18", 2023-11-19T00:39:06.271 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:06.271 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:06.271 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:06.271 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:06.272 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:06.272 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:06.272 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:06.272 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:06.272 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:06.273 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:06.273 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:06.273 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:06.273 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:06.273 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:06.273 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:06.274 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:06.274 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:06.274 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:06.274 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:06.274 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:06.275 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:06.275 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:06.275 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:06.275 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:06.275 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:06.275 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:06.277 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:06.277 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:06.277 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:06.277 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:06.277 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2023-11-19T00:39:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_bias": 4, 2023-11-19T00:39:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 16, 2023-11-19T00:39:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_priority": 5 2023-11-19T00:39:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.279 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:06.279 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2023-11-19T00:39:06.279 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": "cephfs" 2023-11-19T00:39:06.279 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.279 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.280 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:06.280 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.1299999952316284, 2023-11-19T00:39:06.280 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.1299999952316284, 2023-11-19T00:39:06.280 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 1, 2023-11-19T00:39:06.280 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.1299999952316284, 2023-11-19T00:39:06.280 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.1299999952316284, 2023-11-19T00:39:06.281 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:06.281 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:06.281 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:06.281 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.281 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.281 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.282 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 4, 2023-11-19T00:39:06.282 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_data", 2023-11-19T00:39:06.282 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:43.103062+0000", 2023-11-19T00:39:06.282 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:06.282 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:06.283 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:06.283 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:06.283 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:06.283 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:06.283 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:06.283 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:06.284 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:06.284 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:06.284 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:06.284 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:06.284 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 64, 2023-11-19T00:39:06.284 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 64, 2023-11-19T00:39:06.285 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 64, 2023-11-19T00:39:06.285 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 64, 2023-11-19T00:39:06.285 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 64, 2023-11-19T00:39:06.285 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:06.285 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:06.285 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:06.286 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:06.286 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:06.286 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:06.286 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:06.286 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.287 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "19", 2023-11-19T00:39:06.287 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:06.287 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:06.287 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:06.287 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:06.287 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:06.288 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:06.288 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:06.288 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:06.288 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:06.288 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:06.288 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:06.289 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:06.289 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:06.289 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:06.289 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:06.289 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:06.289 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:06.289 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:06.290 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:06.291 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 64, 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "target_size_ratio": 0.89999997615814209 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: "data": "cephfs" 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.292 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.1299999952316284, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.1299999952316284, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 1, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.1299999952316284, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.1299999952316284, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:06.293 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:06.294 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.294 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.294 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:06.294 INFO:teuthology.orchestra.run.smithi046.stdout: "osds": [ 2023-11-19T00:39:06.294 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.294 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2023-11-19T00:39:06.295 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "ecde3678-8154-4745-bf35-fa177f3451e1", 2023-11-19T00:39:06.295 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2023-11-19T00:39:06.295 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2023-11-19T00:39:06.295 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2023-11-19T00:39:06.295 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2023-11-19T00:39:06.295 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2023-11-19T00:39:06.296 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2023-11-19T00:39:06.296 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 9, 2023-11-19T00:39:06.296 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2023-11-19T00:39:06.296 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2023-11-19T00:39:06.296 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2023-11-19T00:39:06.297 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2023-11-19T00:39:06.297 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.297 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.297 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.297 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6800", 2023-11-19T00:39:06.297 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.298 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.298 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.298 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.298 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6801", 2023-11-19T00:39:06.298 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.299 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.299 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.299 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2023-11-19T00:39:06.299 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.299 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.300 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.300 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6802", 2023-11-19T00:39:06.300 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.300 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.300 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.300 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.301 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6803", 2023-11-19T00:39:06.301 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.301 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.301 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.301 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.302 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2023-11-19T00:39:06.302 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.302 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.302 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.302 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6806", 2023-11-19T00:39:06.303 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.303 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.303 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.303 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.303 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6807", 2023-11-19T00:39:06.304 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.304 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.304 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.304 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.304 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2023-11-19T00:39:06.305 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.305 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.305 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.305 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6804", 2023-11-19T00:39:06.305 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.305 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.306 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.306 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.306 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6805", 2023-11-19T00:39:06.306 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:06.306 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.307 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.307 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.307 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.73:6801/1937409726", 2023-11-19T00:39:06.307 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.73:6803/1937409726", 2023-11-19T00:39:06.307 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.73:6807/1937409726", 2023-11-19T00:39:06.307 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.73:6805/1937409726", 2023-11-19T00:39:06.308 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2023-11-19T00:39:06.308 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2023-11-19T00:39:06.308 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2023-11-19T00:39:06.308 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.308 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.308 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.309 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2023-11-19T00:39:06.309 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6", 2023-11-19T00:39:06.309 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2023-11-19T00:39:06.309 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2023-11-19T00:39:06.309 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2023-11-19T00:39:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6800", 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6801", 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.311 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6802", 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6803", 2023-11-19T00:39:06.312 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6806", 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6807", 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6804", 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.314 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6805", 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.99:6801/2703344366", 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.99:6803/2703344366", 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.99:6807/2703344366", 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.99:6805/2703344366", 2023-11-19T00:39:06.315 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "8c9f9502-5eda-4cac-9485-b0ac8ea158dd", 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2023-11-19T00:39:06.316 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6800", 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6801", 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.318 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6802", 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6803", 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2023-11-19T00:39:06.319 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6806", 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6807", 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6804", 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6805", 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:06.321 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.181:6801/1047303295", 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.181:6803/1047303295", 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.181:6807/1047303295", 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.181:6805/1047303295", 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:06.322 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_xinfo": [ 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2023-11-19T00:38:28.692333+0000", 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2023-11-19T00:39:06.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2023-11-19T00:38:28.704826+0000", 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:06.324 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2023-11-19T00:38:28.702890+0000", 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap": [], 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_items": [], 2023-11-19T00:39:06.325 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_primaries": [], 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_temp": [], 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_temp": [], 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklist": {}, 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "range_blocklist": {}, 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profiles": { 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "default": { 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-failure-domain": "osd", 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "k": "2", 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "m": "1", 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin": "jerasure", 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: "technique": "reed_sol_van" 2023-11-19T00:39:06.326 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps_queue": [], 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "new_removed_snaps": [], 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "new_purged_snaps": [], 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_node_flags": {}, 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "device_class_flags": {}, 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode": { 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_enabled": false, 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_bucket_count": 0, 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "degraded_stretch_mode": 0, 2023-11-19T00:39:06.327 INFO:teuthology.orchestra.run.smithi046.stdout: "recovering_stretch_mode": 0, 2023-11-19T00:39:06.328 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_bucket": 0 2023-11-19T00:39:06.328 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:06.328 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:39:06.329 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:06.329 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:06.330 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': '8d6e5d21-0548-4be9-97cd-ecd717c3d6dc', 'created': '2023-11-19T00:38:22.632723+0000', 'modified': '2023-11-19T00:38:45.766733+0000', 'last_up_change': '2023-11-19T00:38:32.614375+0000', 'last_in_change': '2023-11-19T00:38:23.684697+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-19T00:38:42.590087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-19T00:38:43.103062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'ecde3678-8154-4745-bf35-fa177f3451e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6800', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6801', 'nonce': 1937409726}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 1937409726}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6806', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6807', 'nonce': 1937409726}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6804', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6805', 'nonce': 1937409726}]}, 'public_addr': '172.21.15.73:6801/1937409726', 'cluster_addr': '172.21.15.73:6803/1937409726', 'heartbeat_back_addr': '172.21.15.73:6807/1937409726', 'heartbeat_front_addr': '172.21.15.73:6805/1937409726', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6800', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6801', 'nonce': 2703344366}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6802', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6803', 'nonce': 2703344366}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6806', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6807', 'nonce': 2703344366}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6804', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6805', 'nonce': 2703344366}]}, 'public_addr': '172.21.15.99:6801/2703344366', 'cluster_addr': '172.21.15.99:6803/2703344366', 'heartbeat_back_addr': '172.21.15.99:6807/2703344366', 'heartbeat_front_addr': '172.21.15.99:6805/2703344366', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '8c9f9502-5eda-4cac-9485-b0ac8ea158dd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6800', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6801', 'nonce': 1047303295}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6802', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6803', 'nonce': 1047303295}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6806', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6807', 'nonce': 1047303295}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6804', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6805', 'nonce': 1047303295}]}, 'public_addr': '172.21.15.181:6801/1047303295', 'cluster_addr': '172.21.15.181:6803/1047303295', 'heartbeat_back_addr': '172.21.15.181:6807/1047303295', 'heartbeat_front_addr': '172.21.15.181:6805/1047303295', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-11-19T00:38:28.692333+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-11-19T00:38:28.704826+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-11-19T00:38:28.702890+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-11-19T00:39:06.330 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-11-19T00:39:06.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:06.343 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:06.342+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:06.419 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-19T00:39:06.431 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-19T00:39:06.432 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-19T00:39:06.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:06.433 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-11-19T00:39:06.443 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:06.443+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:06.448 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-19T00:39:06.448 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-19T00:39:06.448 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-11-19T00:39:06.448 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-11-19T00:39:06.448 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-11-19T00:39:06.449 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-11-19T00:39:06.449 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-19T00:39:06.449 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-11-19T00:39:06.449 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-11-19T00:39:06.449 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-19T00:39:06.449 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-11-19T00:39:06.449 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-11-19T00:39:06.450 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-19T00:39:06.450 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-11-19T00:39:06.450 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-11-19T00:39:06.450 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-19T00:39:06.451 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42689sec preferred_lft 42689sec 2023-11-19T00:39:06.451 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2023-11-19T00:39:06.451 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-11-19T00:39:06.451 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-19T00:39:06.451 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-11-19T00:39:06.451 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-11-19T00:39:06.452 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-19T00:39:06.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:06.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-11-19T00:39:06.453 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-11-19T00:39:06.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2023-11-19T00:39:06.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2023-11-19T00:39:06.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2023-11-19T00:39:06.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-19T00:39:06.453 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-11-19T00:39:06.454 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:06.454 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:06.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:06.544 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:06.544+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:06.602 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:06.602 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:06.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:39:06.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:06.639 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-19T00:39:06.645 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:06.645+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:06.670 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-11-19T00:39:06.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:06.671 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-11-19T00:39:06.716 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:06.717 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:06.726 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:06.741 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-11-19T00:39:06.742 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-19T00:39:06.742 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-19T00:39:06.742 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-19T00:39:06.742 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-19T00:39:06.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:06.742 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-11-19T00:39:06.743 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-11-19T00:39:06.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-19T00:39:06.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-19T00:39:06.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-19T00:39:06.743 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-11-19T00:39:06.746 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:06.746+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:06.843 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:06.843 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:06.847 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:06.847+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:06.853 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:06.949 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:06.948+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:06.958 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:06.958 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:06.967 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:07.050 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:07.050+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:07.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.052 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-11-19T00:39:07.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.068 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-11-19T00:39:07.073 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.073 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:07.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.124 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-11-19T00:39:07.124 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-11-19T00:39:07.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-19T00:39:07.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-19T00:39:07.124 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-11-19T00:39:07.151 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:07.150+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:07.191 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.192 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:07.219 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-19T00:39:07.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-11-19T00:39:07.219 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-11-19T00:39:07.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-19T00:39:07.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-19T00:39:07.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-19T00:39:07.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-19T00:39:07.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-19T00:39:07.220 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-11-19T00:39:07.252 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:07.251+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:07.352 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:07.351+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:07.354 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.354 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.360 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-11-19T00:39:07.361 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-11-19T00:39:07.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-11-19T00:39:07.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2023-11-19T00:39:07.361 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-11-19T00:39:07.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:07.410 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-19T00:39:07.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-19T00:39:07.410 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:07.427 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-19T00:39:07.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-19T00:39:07.427 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:07.453 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:07.453+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:07.468 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.468 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.477 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:07.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-11-19T00:39:07.553 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:07.553+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:07.555 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2023-11-19T00:39:07.586 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.586 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:07.611 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2023-11-19T00:39:07.611 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2023-11-19T00:39:07.612 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2023-11-19T00:39:07.613 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2023-11-19T00:39:07.614 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-19T00:39:07.615 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-19T00:39:07.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.616 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-11-19T00:39:07.654 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:07.654+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:07.670 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-19T00:39:07.671 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-19T00:39:07.698 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.699 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.707 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:07.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-11-19T00:39:07.743 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2023-11-19T00:39:07.755 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:07.755+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:07.799 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2023-11-19T00:39:07.800 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-19T00:39:07.801 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2023-11-19T00:39:07.802 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2023-11-19T00:39:07.802 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2023-11-19T00:39:07.802 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2023-11-19T00:39:07.802 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-19T00:39:07.802 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-19T00:39:07.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.802 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-11-19T00:39:07.814 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.814 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:07.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2023-11-19T00:39:07.822+0000 7fa001c56480 -1 init, newargv = 0x557245666d90 newargc=15 2023-11-19T00:39:07.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[85811]: starting ceph client 2023-11-19T00:39:07.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[85811]: starting fuse 2023-11-19T00:39:07.840 INFO:teuthology.orchestra.run.smithi046.stdout:41 2023-11-19T00:39:07.840 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-19T00:39:07.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2023-11-19T00:39:07.840 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2023-11-19T00:39:07.840 DEBUG:teuthology.orchestra.run.smithi046:> import re 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> import os 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2023-11-19T00:39:07.841 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2023-11-19T00:39:07.842 DEBUG:teuthology.orchestra.run.smithi046:> return f 2023-11-19T00:39:07.843 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-19T00:39:07.843 DEBUG:teuthology.orchestra.run.smithi046:> 2023-11-19T00:39:07.843 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2023-11-19T00:39:07.843 DEBUG:teuthology.orchestra.run.smithi046:> ' 2023-11-19T00:39:07.856 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:07.856+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:07.937 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:07.937 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:07.947 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:07.957 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:07.956+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:07.965 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.85811.asok 2023-11-19T00:39:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-11-19T00:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-19T00:39:07.976 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85811.asok 2023-11-19T00:39:07.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:07.976 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85811.asok status 2023-11-19T00:39:08.051 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:08.051 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:08.057 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:08.057+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:08.060 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:08.118 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:39:08.118 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2023-11-19T00:39:08.118 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-19T00:39:08.118 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-19T00:39:08.118 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2023-11-19T00:39:08.118 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "85811", 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4570, 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2023-11-19T00:39:08.119 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4570 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3327688873 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3327688873 2023-11-19T00:39:08.120 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4570 192.168.0.1:0/3327688873", 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/3327688873", 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 5, 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 20, 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2023-11-19T00:39:08.121 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:39:08.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:08.127 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2023-11-19T00:39:08.127 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:08.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:08.142 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2023-11-19T00:39:08.142 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:08.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:39:08.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:08.158 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:08.157+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:08.206 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:08.214 INFO:teuthology.run_tasks:Running task workunit... 2023-11-19T00:39:08.229 INFO:tasks.workunit:Pulling workunits from ref b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:39:08.230 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-19T00:39:08.230 INFO:tasks.workunit:timeout=6h 2023-11-19T00:39:08.230 INFO:tasks.workunit:cleanup=True 2023-11-19T00:39:08.230 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:08.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:08.269 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:08.269 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-19T00:39:08.269 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 29h/41d Inode: 1 Links: 2 2023-11-19T00:39:08.269 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-19T00:39:08.270 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:fusefs_t:s0 2023-11-19T00:39:08.270 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-19T00:39:08.270 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-11-19 00:38:44.763840341 +0000 2023-11-19T00:39:08.270 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-11-19 00:39:08.212515100 +0000 2023-11-19T00:39:08.270 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-11-19T00:39:08.270 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-19T00:39:08.270 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-19T00:39:08.274 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:08.274+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:08.312 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:08.313 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:08.330 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:08.331 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:08.340 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:08.340 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:08.340 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:08.345 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-19T00:39:08.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:08.349 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:08.359 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:08.359+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:08.365 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-19T00:39:08.460 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:08.460+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:08.494 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:08.494 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:08.494 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:08.494 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:08.494 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:08.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:08.561 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:08.561+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.837149759999999, 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.836156994, 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.836096605000002, 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.836044481999998, 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.835998803999999, 2023-11-19T00:39:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.835971878999999, 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.835943909000001, 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.835917111000001, 2023-11-19T00:39:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.835886362, 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.835865106, 2023-11-19T00:39:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.829807314, 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:08.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:08.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.829757598, 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:08.671 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:08.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.675 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.829242910000001, 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.828881171999999, 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:08.681 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:08.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.685 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.828592234999999, 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:08.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.826191401999999, 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000212492, 2023-11-19T00:39:08.691 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781126+0000", 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2600000000000001e-07 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781128+0000", 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9180000000000001e-06 2023-11-19T00:39:08.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781133+0000", 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.711e-06 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781149+0000", 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5993000000000001e-05 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781260+0000", 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011063799999999999 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781338+0000", 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8005999999999998e-05 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.826157899999998, 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.826129354999999, 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.758517792999999, 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:08.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:08.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:08.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.850281+0000", 2023-11-19T00:39:08.712 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.757035655999999, 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018650700000000001, 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850281+0000", 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850281+0000", 2023-11-19T00:39:08.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850282+0000", 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5199999999999995e-07 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850287+0000", 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8110000000000002e-06 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850300+0000", 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2988e-05 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850306+0000", 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.409e-06 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:08.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850388+0000", 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1981e-05 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850396+0000", 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5970000000000003e-06 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850468+0000", 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.716 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:08.717 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:08.717 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:08.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:39:08.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:08.720 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:08.718+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:08.819 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:08.818+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:08.835 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:08.835 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:08.845 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:08.920 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:08.919+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:08.950 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:08.950 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:08.950 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:08.950 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:08.950 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:08.959 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:09.020 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:09.020+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:09.065 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.357703116000003, 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:09.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:09.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.357093947000003, 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:09.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.075 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.501481587999997, 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:09.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.295688515999998, 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:09.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:09.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.295005522, 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:09.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.29495863, 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:09.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:09.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:09.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.294918911, 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:09.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:09.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:09.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.29486459, 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:09.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.294803923, 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:09.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:09.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.294678017999999, 2023-11-19T00:39:09.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:09.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:09.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:09.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.294649835000001, 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:09.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.282619108999999, 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.126 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.282573081999999, 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:09.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.282539462999999, 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.139 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.282492703999999, 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:09.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.144 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.282272629000001, 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:09.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:09.148 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.282149252, 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:09.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:09.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.281972933999999, 2023-11-19T00:39:09.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.280278806999998, 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.158 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:09.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:09.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.279227035000002, 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:09.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:09.167 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:09.169 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:09.169 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:09.168+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:09.269 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:09.269+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:09.282 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:09.283 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:09.283 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:09.283 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:09.292 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:09.371 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:09.370+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:09.437 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:09.438 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:09.438 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:09.438 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:09.438 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:09.447 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:09.471 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:09.471+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:09.554 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.921914770999997, 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.396215994000002, 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.396102178, 2023-11-19T00:39:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.396076788000002, 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.995301060999999, 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.784497718000001, 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.784006999999999, 2023-11-19T00:39:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.783954377000001, 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.782477927999999, 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.782433669, 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.782391265000001, 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.782344424000001, 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.782273177, 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:09.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:09.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.782076741000001, 2023-11-19T00:39:09.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:09.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:09.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.78202499, 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:09.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:09.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.781819541000001, 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:09.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:09.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.781768605, 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:09.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.781330223000001, 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.781293094999999, 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:09.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:09.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:09.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.692 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.781232311, 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:09.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:09.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:09.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:09.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:09.698 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:39:09.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:09.701 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:09.699+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:09.800 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:09.800+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:09.817 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:09.817 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:09.817 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:09.817 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:09.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:09.901 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:09.901+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:09.971 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:09.971 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:09.972 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:09.972 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:09.972 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:09.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:10.024 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:10.023+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:10.086 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:10.086 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:10.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:10.087 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:10.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.087 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:10.087 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:10.087 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.314586001999999, 2023-11-19T00:39:10.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:10.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:10.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:10.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:10.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313593235999999, 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:10.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:10.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313532847000001, 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:10.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:10.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:10.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313480724000001, 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:10.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:10.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:10.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:10.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:10.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:10.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:10.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:10.119 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313435045999999, 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:10.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:10.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.126 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313408120999998, 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:10.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:10.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:10.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:10.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:10.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:10.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:10.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313380151, 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.135 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:10.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:10.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:10.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:10.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:10.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:10.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:10.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:10.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:10.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:10.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:10.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:10.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:10.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:10.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.144 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.144 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.145 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:10.145 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313353353, 2023-11-19T00:39:10.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:10.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:10.145 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:10.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:10.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:10.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:10.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:10.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:10.152 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313322604, 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:10.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:10.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.313301348, 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:10.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:10.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:10.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:10.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:10.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:10.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.307243556, 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:10.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.167 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.30719384, 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:10.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:10.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:10.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.306679152000001, 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.179 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.306317413999999, 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.183 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.306028477000002, 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:10.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:10.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.303627643999999, 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000212492, 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:10.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781126+0000", 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2600000000000001e-07 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781128+0000", 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9180000000000001e-06 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781133+0000", 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.711e-06 2023-11-19T00:39:10.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781149+0000", 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5993000000000001e-05 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781260+0000", 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011063799999999999 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781338+0000", 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8005999999999998e-05 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.303594142000001, 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:10.193 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.194 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.194 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:10.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:10.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:10.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:10.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:10.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:10.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:10.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.303565596999999, 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:10.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:10.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:10.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.205 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 20.235954034999999, 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.206 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:10.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:10.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:10.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:10.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:10.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:10.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:10.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:10.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:10.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:10.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:10.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:10.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:10.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:10.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:10.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:10.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.23547006100000001, 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:10.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:10.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:10.222 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:10.223 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:10.224 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:10.225 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:10.223+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:10.325 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:10.324+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:10.340 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:10.340 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:10.340 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:10.340 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:10.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:10.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:10.425 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:10.424+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:10.456 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:10.456 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:10.456 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:10.465 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:10.502 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:10.502 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:10.520 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:10.526 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:10.524+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:10.539 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:10.539 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:10.570 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:10.570 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:10.579 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:10.627 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:10.626+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:10.695 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:10.695 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:10.704 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:10.728 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:10.728+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:10.830 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:10.829+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:10.849 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:10.849 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:10.858 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:10.930 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:10.930+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:10.963 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:10.963 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:10.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:11.031 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:11.030+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:11.089 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:11.090 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:11.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:11.132 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:11.132+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:11.202 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:11.202 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:11.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:11.233 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:11.232+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:11.317 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:11.317 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:11.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:11.331 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:11.331 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:11.331 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-11-19T00:39:11.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2023-11-19T00:39:11.334 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:11.333+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:11.435 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:11.434+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:11.442 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:11.442 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:11.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:11.536 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:11.535+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:11.598 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:11.598 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:11.607 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:11.634 INFO:teuthology.orchestra.run.smithi046.stdout:moved 0 / 210 (0%) 2023-11-19T00:39:11.634 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:39:11.634 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout:oload 110 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 0.05 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0003 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0004 2023-11-19T00:39:11.635 INFO:teuthology.orchestra.run.smithi046.stderr:no change 2023-11-19T00:39:11.647 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-11-19T00:39:11.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2023-11-19T00:39:11.649 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:11.648+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:11.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:39:11.738 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:11.737+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:11.763 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:11.839 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:11.837+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:11.880 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:11.880 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:11.889 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:11.941 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:11.940+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:11.949 INFO:teuthology.orchestra.run.smithi046.stdout:moved 0 / 210 (0%) 2023-11-19T00:39:11.949 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:39:11.949 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout:oload 110 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 3 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0003 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0004 2023-11-19T00:39:11.950 INFO:teuthology.orchestra.run.smithi046.stderr:no change 2023-11-19T00:39:11.961 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-11-19T00:39:11.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2023-11-19T00:39:12.035 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:12.036 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:12.042 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:12.041+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:12.044 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:12.142 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:12.142+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:12.148 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:12.148 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:12.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:12.243 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:12.242+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:12.259 INFO:teuthology.orchestra.run.smithi046.stdout:moved 0 / 210 (0%) 2023-11-19T00:39:12.259 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:39:12.259 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2023-11-19T00:39:12.259 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2023-11-19T00:39:12.259 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2023-11-19T00:39:12.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:12.260 INFO:teuthology.orchestra.run.smithi046.stdout:oload 1000 2023-11-19T00:39:12.260 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 0.05 2023-11-19T00:39:12.260 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:39:12.260 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0003 2023-11-19T00:39:12.260 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0032 2023-11-19T00:39:12.260 INFO:teuthology.orchestra.run.smithi046.stderr:no change 2023-11-19T00:39:12.269 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:12.270 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:12.271 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2023-11-19T00:39:12.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2023-11-19T00:39:12.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:12.344 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:12.343+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:12.383 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:12.383 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:12.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:12.444 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:12.443+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:12.498 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:12.499 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:12.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:12.549 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:12.549+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:12.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout:moved 0 / 210 (0%) 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout:oload 1000 2023-11-19T00:39:12.563 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 3 2023-11-19T00:39:12.564 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:39:12.564 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0003 2023-11-19T00:39:12.564 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0032 2023-11-19T00:39:12.564 INFO:teuthology.orchestra.run.smithi046.stderr:no change 2023-11-19T00:39:12.577 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2023-11-19T00:39:12.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2023-11-19T00:39:12.618 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:12.619 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:12.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:12.647 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:39:12.671 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:12.671+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:12.686 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:12.686 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:12.704 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:12.705 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:12.723 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:12.723 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:12.732 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:12.732 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:12.741 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:12.747 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:12.747+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:12.849 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:12.848+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.180025720000003, 2023-11-19T00:39:12.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:12.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:12.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:12.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.893 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.179416551000003, 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:12.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:12.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:12.898 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.323804191999997, 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:12.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.118011119999998, 2023-11-19T00:39:12.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:12.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.909 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.117328126, 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:12.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:12.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.117281234, 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:12.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:12.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.921 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.117241515, 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:12.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:12.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:12.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:12.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.117187194, 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:12.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:12.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.117126527, 2023-11-19T00:39:12.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:12.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:12.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.117000621999999, 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:12.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:12.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.116972439000001, 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.104941712999999, 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.953 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:12.957 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.104895685999999, 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:12.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:12.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.104862066999999, 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.104815307999999, 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.104595233000001, 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.972 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.975 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.104471856, 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.104295537999999, 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.980 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:12.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.102601410999998, 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:12.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:12.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.101549639000002, 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:12.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:12.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:12.994 INFO:teuthology.orchestra.run.smithi046.stdout:moved 0 / 210 (0%) 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:oload 1000 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 1 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0003 2023-11-19T00:39:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0032 2023-11-19T00:39:12.996 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:12.994+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:12.997 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:no change 2023-11-19T00:39:13.095 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:13.095+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:13.108 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:13.109 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:13.109 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:13.109 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:13.117 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:13.196 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:13.195+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:13.222 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:13.222 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:13.222 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:13.222 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:13.222 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:13.231 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:13.296 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:13.296+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:13.339 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.70692683, 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:13.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:13.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:13.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:13.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:13.349 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.349 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.349 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.181228052999998, 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.350 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:13.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:13.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:13.356 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.181114237000003, 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:13.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.362 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.181088846999998, 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:13.363 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:13.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 36.780313120000002, 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:13.369 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:13.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.569509777, 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:13.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:13.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:13.382 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.569019058999999, 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:13.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:13.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.568966436, 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.389 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:13.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:13.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:13.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.567489986999998, 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:13.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:13.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.567445727999999, 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.403 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:13.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:13.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:13.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.567403324000001, 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.410 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:13.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:13.416 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.567356483000001, 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:13.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:13.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:13.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.423 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.567285236, 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:13.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:13.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:13.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.567088800000001, 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:13.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:13.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.567037049, 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:13.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.5668316, 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.451 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.566780663999999, 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:13.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:13.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:13.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.458 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.566342282000001, 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.566305153999998, 2023-11-19T00:39:13.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:13.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:13.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.56624437, 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:13.472 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:13.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:13.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:13.477 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:13.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:13.479 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:13.478+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:13.580 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:13.578+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:13.595 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:13.595 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:13.595 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:13.595 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:13.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:13.681 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:13.680+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:13.709 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:13.709 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:13.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:13.782 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:13.781+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:13.824 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.052968942, 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:13.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051976176, 2023-11-19T00:39:13.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:13.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:13.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051915786999999, 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:13.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:13.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051863663999999, 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:13.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:13.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:13.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051817986, 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.848 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:13.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:13.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:13.854 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051791060999999, 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.860 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051763091000002, 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:13.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051736293000001, 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051705544000001, 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.051684288000001, 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.045626496000001, 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.045576780000001, 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:13.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.045062091999998, 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.044700354, 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.894 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:13.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.044411416999999, 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:13.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:13.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:13.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.903 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.042010584, 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000212492, 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781125+0000", 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781126+0000", 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2600000000000001e-07 2023-11-19T00:39:13.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781128+0000", 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9180000000000001e-06 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781133+0000", 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.711e-06 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781149+0000", 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5993000000000001e-05 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781260+0000", 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011063799999999999 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781338+0000", 2023-11-19T00:39:13.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8005999999999998e-05 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.041977081999999, 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:13.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:13.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.041948537, 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.913 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:13.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.974336975, 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.918 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.9738530010000002, 2023-11-19T00:39:13.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:13.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:13.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:13.930 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:13.932 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:13.932 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:13.930+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:14.033 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:14.032+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:14.048 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:14.048 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:14.048 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:14.049 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:14.058 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:14.142 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:14.141+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:14.203 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:14.203 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:14.203 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:14.203 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:14.203 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:14.212 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:14.234 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:14.233+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:14.335 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:14.334+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.651981372000002, 2023-11-19T00:39:14.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:14.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:14.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:14.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.651372203000001, 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:14.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:14.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:14.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.375 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.795759844000003, 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:14.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:14.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:14.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:14.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.382 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.589966772, 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:14.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.390 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.589283777999999, 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:14.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:14.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:14.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:14.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.589236885999998, 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:14.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:14.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:14.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:14.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.589197167000002, 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:14.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:14.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:14.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.411 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.589142846000001, 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:14.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:14.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.589082179000002, 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.418 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:14.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:14.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:14.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.588956274000001, 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:14.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:14.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.588928091, 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:14.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.576897365000001, 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:14.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:14.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:14.441 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.576851338000001, 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:14.446 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.576817719000001, 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:14.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:14.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.576770960000001, 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:14.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.576550885, 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:14.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.576427507999998, 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.461 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:14.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:14.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:14.466 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.576251190000001, 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:14.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.574557063, 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:14.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.476 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.573505291, 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:14.481 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:14.483 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:14.483 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:14.482+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:14.584 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:14.583+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:14.601 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:14.601 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:14.601 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:14.601 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:14.609 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:14.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:39:14.684 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:14.683+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:14.715 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:14.715 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:14.715 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:14.715 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:14.715 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:14.724 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:14.734 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:14.786 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:14.785+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:14.870 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:14.871 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:14.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:14.871 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:14.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.871 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:14.871 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:14.871 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.238120176999999, 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.872 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:14.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:14.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:14.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:14.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:14.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:14.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:14.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:14.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.882 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.712421399999997, 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:14.883 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:14.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:14.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:14.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.712307584000001, 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.892 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:14.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:14.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:14.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.712282193999997, 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:14.901 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:14.902 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:14.902 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:14.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.902 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:14.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:14.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:14.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.311506467000001, 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.910 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:14.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:14.919 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.100703123999999, 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.100212406000001, 2023-11-19T00:39:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.100159782999999, 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:14.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:14.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.098683334, 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:14.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:14.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:14.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.098639075000001, 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.098596670999999, 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.09854983, 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.098478582999999, 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:14.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:14.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.098282146999999, 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:14.987 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:14.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:14.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.098230396000002, 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:14.994 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:14.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:14.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:14.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:14.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:14.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:15.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.098024946999999, 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:15.001 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:15.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:15.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:15.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:15.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.097974011000002, 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:15.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:15.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:15.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:15.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:15.014 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.097535628999999, 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:15.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:15.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:15.021 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.097498501, 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:15.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:15.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:15.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:15.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:15.028 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.097437716999998, 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:15.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:15.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:15.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.033 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:15.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:15.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:15.034 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:15.035 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:15.035 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:15.036 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:15.036 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:15.037 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:15.034+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:15.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:15.037 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:15.038 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:15.136 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:15.135+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:15.153 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:15.153 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:15.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:15.237 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:15.237+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:15.308 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:15.309 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:15.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:15.338 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:15.337+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:15.422 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:15.422 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:15.430 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:15.475 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:15.474+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:15.540 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:15.539+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:15.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:15.642 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:15.641+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:15.659 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:39:15.699 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:15.699 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:15.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:15.743 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:15.742+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:15.844 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:15.843+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:15.853 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:15.854 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:15.863 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:15.944 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:15.943+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:15.979 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:15.979 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:15.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:16.044 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:16.044+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:16.094 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.094 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.102 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:16.146 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:16.145+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:16.207 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.207 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:16.246 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:16.245+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:16.323 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.324 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.333 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:16.347 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:16.346+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:16.438 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.438 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:16.448 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:16.447+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:16.549 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:16.549+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:16.551 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.552 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:16.650 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:16.650+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:16.668 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.668 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:16.762 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:16.761+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:16.823 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.824 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.832 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:16.851 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:16.851+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:16.952 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:16.951+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:16.976 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:16.976 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:16.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:17.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:17.053 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:17.052+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:17.101 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:17.102 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:17.111 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:17.154 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:17.153+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:17.169 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:17.188 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:17.188 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:17.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:17.205 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:17.216 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:17.216 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:17.216 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:17.216 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:17.216 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:17.225 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:17.255 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:17.255+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:17.358 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:17.356+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:17.372 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.739693867, 2023-11-19T00:39:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.213995089999997, 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.213881274000002, 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.213855883999997, 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.813080157000002, 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.602276814, 2023-11-19T00:39:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.601786095999998, 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.601733473000003, 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.600257024000001, 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.600212765000002, 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:17.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.454 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.600170360999996, 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:17.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.600123519999997, 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:17.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:17.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:17.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.468 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.600052273000003, 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:17.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:17.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.599855837, 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:17.475 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:17.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:17.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.599804085999999, 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.482 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:17.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:17.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.599598637, 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:17.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:17.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.495 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.599547700999999, 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:17.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.502 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.599109319, 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:17.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:17.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.599072190999998, 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:17.509 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:17.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.515 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.599011406999999, 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:17.521 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:17.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:17.523 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:17.521+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:17.623 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:17.622+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:17.640 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:17.640 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:17.641 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:17.641 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:17.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:17.672 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:39:17.728 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:17.726+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:17.754 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:17.754 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:17.754 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:17.754 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:17.754 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:17.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:17.827 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:17.824+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:17.925 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.150529048000003, 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.926 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149536282, 2023-11-19T00:39:17.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:17.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149475893000002, 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.936 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:17.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.941 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149423769999999, 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:17.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:17.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149378091999999, 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:17.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:17.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:17.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149351166999999, 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.959 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149323197000001, 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:17.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:17.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:17.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:17.965 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149296399000001, 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:17.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:17.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149265649999997, 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.149244394, 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.979 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.143186602, 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:17.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.143136886000001, 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:17.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.987 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:17.926+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:17.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:17.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.142622197999998, 2023-11-19T00:39:17.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:17.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:17.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.142260460000003, 2023-11-19T00:39:17.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:17.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:17.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.141971523000002, 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:18.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:18.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:18.004 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.139537187999998, 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:18.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:18.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.009 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.139508642999999, 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:18.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:18.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 28.071897080999999, 2023-11-19T00:39:18.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:18.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:18.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:18.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.0714131069999997, 2023-11-19T00:39:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:18.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:18.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:18.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:18.026 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.0712571899999999, 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:18.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:18.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:18.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:18.032 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:18.033 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:18.033 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:18.033 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:18.033 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-11-19T00:39:18.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-11-19T00:39:18.040 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:18.039+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:18.136 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:18.135+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:18.156 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:18.156 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:18.156 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:18.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:18.237 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:18.236+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:18.277 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:18.278 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:18.278 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:18.278 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:18.278 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:18.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:18.339 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:18.338+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:18.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 23, 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "fsid": "8d6e5d21-0548-4be9-97cd-ecd717c3d6dc", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "created": "2023-11-19T00:38:22.632723+0000", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "modified": "2023-11-19T00:39:15.652803+0000", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "last_up_change": "2023-11-19T00:38:32.614375+0000", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "last_in_change": "2023-11-19T00:38:23.684697+0000", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_num": 5799936, 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_set": [ 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "pglog_hardlimit", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "purged_snapdirs", 2023-11-19T00:39:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_deletes", 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "sortbitwise" 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_version": 4, 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "full_ratio": 0.94999998807907104, 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "nearfull_ratio": 0.85000002384185791, 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_snapshot": "", 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_max": 4, 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd": 3, 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "require_min_compat_client": "luminous", 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "min_compat_client": "jewel", 2023-11-19T00:39:18.349 INFO:teuthology.orchestra.run.smithi046.stdout: "require_osd_release": "reef", 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_crimson": false, 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": [ 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 1, 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": ".mgr", 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:33.077694+0000", 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:18.350 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 1, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 1, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 1, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 1, 2023-11-19T00:39:18.351 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 1, 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "12", 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:18.352 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_max": 32, 2023-11-19T00:39:18.355 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 1 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": {} 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 2.9900000095367432, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 2.9900000095367432, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 2, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 2, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:18.356 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 2, 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "rbd", 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:37.909259+0000", 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:18.357 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 8, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 8, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 8, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 8, 2023-11-19T00:39:18.358 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 8, 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "15", 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:18.359 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:18.360 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:18.361 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "options": {}, 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd": {} 2023-11-19T00:39:18.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.5, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.5, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 1, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.5, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.5, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.363 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 3, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_metadata", 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:42.590087+0000", 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:18.364 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 32, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 32, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 32, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 32, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 32, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:18.365 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "18", 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_bias": 4, 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 16, 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_priority": 5 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2023-11-19T00:39:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": "cephfs" 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.1299999952316284, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.1299999952316284, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 1, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.1299999952316284, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.1299999952316284, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 4, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_data", 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2023-11-19T00:38:43.103062+0000", 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2023-11-19T00:39:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 64, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 64, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 64, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 64, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 64, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2023-11-19T00:39:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "19", 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2023-11-19T00:39:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2023-11-19T00:39:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2023-11-19T00:39:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 64, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "target_size_ratio": 0.89999997615814209 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2023-11-19T00:39:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: "data": "cephfs" 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.1299999952316284, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.1299999952316284, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 1, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.1299999952316284, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.1299999952316284, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 1, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 1, 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 1 2023-11-19T00:39:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "osds": [ 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "ecde3678-8154-4745-bf35-fa177f3451e1", 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2023-11-19T00:39:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 9, 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6800", 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6801", 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6802", 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6803", 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6806", 2023-11-19T00:39:18.381 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6807", 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6804", 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.73:6805", 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1937409726 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.73:6801/1937409726", 2023-11-19T00:39:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.73:6803/1937409726", 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.73:6807/1937409726", 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.73:6805/1937409726", 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6", 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2023-11-19T00:39:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6800", 2023-11-19T00:39:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6801", 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6802", 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6803", 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.387 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6806", 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6807", 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.388 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6804", 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.99:6805", 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2703344366 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.99:6801/2703344366", 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.99:6803/2703344366", 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.99:6807/2703344366", 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.99:6805/2703344366", 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2023-11-19T00:39:18.390 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "8c9f9502-5eda-4cac-9485-b0ac8ea158dd", 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.391 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6800", 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6801", 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.392 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6802", 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6803", 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.393 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6806", 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6807", 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.394 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6804", 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.181:6805", 2023-11-19T00:39:18.395 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1047303295 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.181:6801/1047303295", 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.181:6803/1047303295", 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.181:6807/1047303295", 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.181:6805/1047303295", 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.396 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_xinfo": [ 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2023-11-19T00:38:28.692333+0000", 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2023-11-19T00:38:28.704826+0000", 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2023-11-19T00:39:18.398 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2023-11-19T00:38:28.702890+0000", 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap": [], 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_items": [], 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_primaries": [], 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_temp": [], 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_temp": [], 2023-11-19T00:39:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklist": {}, 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "range_blocklist": {}, 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profiles": { 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "default": { 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-failure-domain": "osd", 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "k": "2", 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "m": "1", 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin": "jerasure", 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "technique": "reed_sol_van" 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps_queue": [], 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "new_removed_snaps": [], 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "new_purged_snaps": [], 2023-11-19T00:39:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_node_flags": {}, 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: "device_class_flags": {}, 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode": { 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_enabled": false, 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_bucket_count": 0, 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: "degraded_stretch_mode": 0, 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: "recovering_stretch_mode": 0, 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_bucket": 0 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-11-19T00:39:18.401 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:39:18.404 INFO:tasks.thrashosds.thrasher:j is {'epoch': 23, 'fsid': '8d6e5d21-0548-4be9-97cd-ecd717c3d6dc', 'created': '2023-11-19T00:38:22.632723+0000', 'modified': '2023-11-19T00:39:15.652803+0000', 'last_up_change': '2023-11-19T00:38:32.614375+0000', 'last_in_change': '2023-11-19T00:38:23.684697+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-19T00:38:42.590087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-19T00:38:43.103062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'ecde3678-8154-4745-bf35-fa177f3451e1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6800', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6801', 'nonce': 1937409726}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 1937409726}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6806', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6807', 'nonce': 1937409726}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6804', 'nonce': 1937409726}, {'type': 'v1', 'addr': '172.21.15.73:6805', 'nonce': 1937409726}]}, 'public_addr': '172.21.15.73:6801/1937409726', 'cluster_addr': '172.21.15.73:6803/1937409726', 'heartbeat_back_addr': '172.21.15.73:6807/1937409726', 'heartbeat_front_addr': '172.21.15.73:6805/1937409726', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6800', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6801', 'nonce': 2703344366}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6802', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6803', 'nonce': 2703344366}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6806', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6807', 'nonce': 2703344366}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6804', 'nonce': 2703344366}, {'type': 'v1', 'addr': '172.21.15.99:6805', 'nonce': 2703344366}]}, 'public_addr': '172.21.15.99:6801/2703344366', 'cluster_addr': '172.21.15.99:6803/2703344366', 'heartbeat_back_addr': '172.21.15.99:6807/2703344366', 'heartbeat_front_addr': '172.21.15.99:6805/2703344366', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '8c9f9502-5eda-4cac-9485-b0ac8ea158dd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6800', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6801', 'nonce': 1047303295}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6802', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6803', 'nonce': 1047303295}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6806', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6807', 'nonce': 1047303295}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6804', 'nonce': 1047303295}, {'type': 'v1', 'addr': '172.21.15.181:6805', 'nonce': 1047303295}]}, 'public_addr': '172.21.15.181:6801/1047303295', 'cluster_addr': '172.21.15.181:6803/1047303295', 'heartbeat_back_addr': '172.21.15.181:6807/1047303295', 'heartbeat_front_addr': '172.21.15.181:6805/1047303295', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-11-19T00:38:28.692333+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-11-19T00:38:28.704826+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-11-19T00:38:28.702890+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-11-19T00:39:18.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:39:18.404 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:18.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.685616744000001, 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:18.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:18.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.685007575, 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:18.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:18.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.829395216000002, 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:18.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:18.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.623602144000003, 2023-11-19T00:39:18.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:18.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:18.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.622919150000001, 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:18.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:18.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.622872258000001, 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:18.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:18.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.436 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.622832539000001, 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:18.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.441 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.622778218000001, 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:18.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:18.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.447 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.622717551000001, 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:18.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:18.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.622591646000004, 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:18.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:18.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:18.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.622563462999999, 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:18.459 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:18.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:18.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:18.463 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.610532737, 2023-11-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.464 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:18.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:18.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.610486710000004, 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:18.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.610453090999997, 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:18.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:18.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.477 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.610406331999997, 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:18.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.610186257000002, 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:18.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.610062880000001, 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.486 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:18.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:18.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.609886562, 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:18.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.608192434999999, 2023-11-19T00:39:18.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:18.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.607140663000003, 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:18.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:18.504 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:18.505 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:18.508 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:18.507+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:18.608 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:18.607+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:18.619 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:18.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:18.619 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:18.619 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:18.628 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:18.665 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:39:18.717 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:18.716+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:18.777 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:18.777 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:18.777 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:18.777 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:18.777 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:18.786 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:18.810 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:18.810+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:18.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:39:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:39:18.831 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-11-19T00:39:18.665938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597718,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91176,"kb_used_data":1800,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024344,"statfs":{"total":289910292480,"available":289816928256,"internally_reserved":0,"allocated":1843200,"data_stored":1414055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4940,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.638292"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650728+0000","last_change":"2023-11-19T00:38:44.773330+0000","last_active":"2023-11-19T00:39:12.650728+0000","last_peered":"2023-11-19T00:39:12.650728+0000","last_clean":"2023-11-19T00:39:12.650728+0000","last_became_active":"2023-11-19T00:38:44.772664+0000","last_became_peered":"2023-11-19T00:38:44.772664+0000","last_unstale":"2023-11-19T00:39:12.650728+0000","last_undegraded":"2023-11-19T00:39:12.650728+0000","last_fullsized":"2023-11-19T00:39:12.650728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650556+0000","last_change":"2023-11-19T00:38:44.774556+0000","last_active":"2023-11-19T00:39:12.650556+0000","last_peered":"2023-11-19T00:39:12.650556+0000","last_clean":"2023-11-19T00:39:12.650556+0000","last_became_active":"2023-11-19T00:38:44.774359+0000","last_became_peered":"2023-11-19T00:38:44.774359+0000","last_unstale":"2023-11-19T00:39:12.650556+0000","last_undegraded":"2023-11-19T00:39:12.650556+0000","last_fullsized":"2023-11-19T00:39:12.650556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817829+0000","last_change":"2023-11-19T00:38:44.780160+0000","last_active":"2023-11-19T00:39:12.817829+0000","last_peered":"2023-11-19T00:39:12.817829+0000","last_clean":"2023-11-19T00:39:12.817829+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:39:12.817829+0000","last_undegraded":"2023-11-19T00:39:12.817829+0000","last_fullsized":"2023-11-19T00:39:12.817829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817784+0000","last_change":"2023-11-19T00:38:44.783737+0000","last_active":"2023-11-19T00:39:12.817784+0000","last_peered":"2023-11-19T00:39:12.817784+0000","last_clean":"2023-11-19T00:39:12.817784+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:39:12.817784+0000","last_undegraded":"2023-11-19T00:39:12.817784+0000","last_fullsized":"2023-11-19T00:39:12.817784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650251+0000","last_change":"2023-11-19T00:38:44.772730+0000","last_active":"2023-11-19T00:39:12.650251+0000","last_peered":"2023-11-19T00:39:12.650251+0000","last_clean":"2023-11-19T00:39:12.650251+0000","last_became_active":"2023-11-19T00:38:44.772263+0000","last_became_peered":"2023-11-19T00:38:44.772263+0000","last_unstale":"2023-11-19T00:39:12.650251+0000","last_undegraded":"2023-11-19T00:39:12.650251+0000","last_fullsized":"2023-11-19T00:39:12.650251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817534+0000","last_change":"2023-11-19T00:38:44.782125+0000","last_active":"2023-11-19T00:39:12.817534+0000","last_peered":"2023-11-19T00:39:12.817534+0000","last_clean":"2023-11-19T00:39:12.817534+0000","last_became_active":"2023-11-19T00:38:44.781776+0000","last_became_peered":"2023-11-19T00:38:44.781776+0000","last_unstale":"2023-11-19T00:39:12.817534+0000","last_undegraded":"2023-11-19T00:39:12.817534+0000","last_fullsized":"2023-11-19T00:39:12.817534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817551+0000","last_change":"2023-11-19T00:38:44.782135+0000","last_active":"2023-11-19T00:39:12.817551+0000","last_peered":"2023-11-19T00:39:12.817551+0000","last_clean":"2023-11-19T00:39:12.817551+0000","last_became_active":"2023-11-19T00:38:44.781679+0000","last_became_peered":"2023-11-19T00:38:44.781679+0000","last_unstale":"2023-11-19T00:39:12.817551+0000","last_undegraded":"2023-11-19T00:39:12.817551+0000","last_fullsized":"2023-11-19T00:39:12.817551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817336+0000","last_change":"2023-11-19T00:38:44.777633+0000","last_active":"2023-11-19T00:39:12.817336+0000","last_peered":"2023-11-19T00:39:12.817336+0000","last_clean":"2023-11-19T00:39:12.817336+0000","last_became_active":"2023-11-19T00:38:44.777062+0000","last_became_peered":"2023-11-19T00:38:44.777062+0000","last_unstale":"2023-11-19T00:39:12.817336+0000","last_undegraded":"2023-11-19T00:39:12.817336+0000","last_fullsized":"2023-11-19T00:39:12.817336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650114+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:39:12.650114+0000","last_peered":"2023-11-19T00:39:12.650114+0000","last_clean":"2023-11-19T00:39:12.650114+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:39:12.650114+0000","last_undegraded":"2023-11-19T00:39:12.650114+0000","last_fullsized":"2023-11-19T00:39:12.650114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650507+0000","last_change":"2023-11-19T00:38:44.774445+0000","last_active":"2023-11-19T00:39:12.650507+0000","last_peered":"2023-11-19T00:39:12.650507+0000","last_clean":"2023-11-19T00:39:12.650507+0000","last_became_active":"2023-11-19T00:38:44.773922+0000","last_became_peered":"2023-11-19T00:38:44.773922+0000","last_unstale":"2023-11-19T00:39:12.650507+0000","last_undegraded":"2023-11-19T00:39:12.650507+0000","last_fullsized":"2023-11-19T00:39:12.650507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818023+0000","last_change":"2023-11-19T00:38:44.783507+0000","last_active":"2023-11-19T00:39:12.818023+0000","last_peered":"2023-11-19T00:39:12.818023+0000","last_clean":"2023-11-19T00:39:12.818023+0000","last_became_active":"2023-11-19T00:38:44.782957+0000","last_became_peered":"2023-11-19T00:38:44.782957+0000","last_unstale":"2023-11-19T00:39:12.818023+0000","last_undegraded":"2023-11-19T00:39:12.818023+0000","last_fullsized":"2023-11-19T00:39:12.818023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:03.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650364+0000","last_change":"2023-11-19T00:38:44.774068+0000","last_active":"2023-11-19T00:39:12.650364+0000","last_peered":"2023-11-19T00:39:12.650364+0000","last_clean":"2023-11-19T00:39:12.650364+0000","last_became_active":"2023-11-19T00:38:44.773532+0000","last_became_peered":"2023-11-19T00:38:44.773532+0000","last_unstale":"2023-11-19T00:39:12.650364+0000","last_undegraded":"2023-11-19T00:39:12.650364+0000","last_fullsized":"2023-11-19T00:39:12.650364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650154+0000","last_change":"2023-11-19T00:38:44.774164+0000","last_active":"2023-11-19T00:39:12.650154+0000","last_peered":"2023-11-19T00:39:12.650154+0000","last_clean":"2023-11-19T00:39:12.650154+0000","last_became_active":"2023-11-19T00:38:44.773573+0000","last_became_peered":"2023-11-19T00:38:44.773573+0000","last_unstale":"2023-11-19T00:39:12.650154+0000","last_undegraded":"2023-11-19T00:39:12.650154+0000","last_fullsized":"2023-11-19T00:39:12.650154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817562+0000","last_change":"2023-11-19T00:38:44.779723+0000","last_active":"2023-11-19T00:39:12.817562+0000","last_peered":"2023-11-19T00:39:12.817562+0000","last_clean":"2023-11-19T00:39:12.817562+0000","last_became_active":"2023-11-19T00:38:44.779173+0000","last_became_peered":"2023-11-19T00:38:44.779173+0000","last_unstale":"2023-11-19T00:39:12.817562+0000","last_undegraded":"2023-11-19T00:39:12.817562+0000","last_fullsized":"2023-11-19T00:39:12.817562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817560+0000","last_change":"2023-11-19T00:38:44.779684+0000","last_active":"2023-11-19T00:39:12.817560+0000","last_peered":"2023-11-19T00:39:12.817560+0000","last_clean":"2023-11-19T00:39:12.817560+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:39:12.817560+0000","last_undegraded":"2023-11-19T00:39:12.817560+0000","last_fullsized":"2023-11-19T00:39:12.817560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817391+0000","last_change":"2023-11-19T00:38:44.782828+0000","last_active":"2023-11-19T00:39:12.817391+0000","last_peered":"2023-11-19T00:39:12.817391+0000","last_clean":"2023-11-19T00:39:12.817391+0000","last_became_active":"2023-11-19T00:38:44.782137+0000","last_became_peered":"2023-11-19T00:38:44.782137+0000","last_unstale":"2023-11-19T00:39:12.817391+0000","last_undegraded":"2023-11-19T00:39:12.817391+0000","last_fullsized":"2023-11-19T00:39:12.817391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650339+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:39:12.650339+0000","last_peered":"2023-11-19T00:39:12.650339+0000","last_clean":"2023-11-19T00:39:12.650339+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:39:12.650339+0000","last_undegraded":"2023-11-19T00:39:12.650339+0000","last_fullsized":"2023-11-19T00:39:12.650339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650674+0000","last_change":"2023-11-19T00:38:44.773300+0000","last_active":"2023-11-19T00:39:12.650674+0000","last_peered":"2023-11-19T00:39:12.650674+0000","last_clean":"2023-11-19T00:39:12.650674+0000","last_became_active":"2023-11-19T00:38:44.772404+0000","last_became_peered":"2023-11-19T00:38:44.772404+0000","last_unstale":"2023-11-19T00:39:12.650674+0000","last_undegraded":"2023-11-19T00:39:12.650674+0000","last_fullsized":"2023-11-19T00:39:12.650674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650030+0000","last_change":"2023-11-19T00:38:44.774728+0000","last_active":"2023-11-19T00:39:12.650030+0000","last_peered":"2023-11-19T00:39:12.650030+0000","last_clean":"2023-11-19T00:39:12.650030+0000","last_became_active":"2023-11-19T00:38:44.774283+0000","last_became_peered":"2023-11-19T00:38:44.774283+0000","last_unstale":"2023-11-19T00:39:12.650030+0000","last_undegraded":"2023-11-19T00:39:12.650030+0000","last_fullsized":"2023-11-19T00:39:12.650030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817766+0000","last_change":"2023-11-19T00:38:44.782992+0000","last_active":"2023-11-19T00:39:12.817766+0000","last_peered":"2023-11-19T00:39:12.817766+0000","last_clean":"2023-11-19T00:39:12.817766+0000","last_became_active":"2023-11-19T00:38:44.782616+0000","last_became_peered":"2023-11-19T00:38:44.782616+0000","last_unstale":"2023-11-19T00:39:12.817766+0000","last_undegraded":"2023-11-19T00:39:12.817766+0000","last_fullsized":"2023-11-19T00:39:12.817766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818112+0000","last_change":"2023-11-19T00:38:44.783988+0000","last_active":"2023-11-19T00:39:12.818112+0000","last_peered":"2023-11-19T00:39:12.818112+0000","last_clean":"2023-11-19T00:39:12.818112+0000","last_became_active":"2023-11-19T00:38:44.783063+0000","last_became_peered":"2023-11-19T00:38:44.783063+0000","last_unstale":"2023-11-19T00:39:12.818112+0000","last_undegraded":"2023-11-19T00:39:12.818112+0000","last_fullsized":"2023-11-19T00:39:12.818112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:03:56.284903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650092+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:39:12.650092+0000","last_peered":"2023-11-19T00:39:12.650092+0000","last_clean":"2023-11-19T00:39:12.650092+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:39:12.650092+0000","last_undegraded":"2023-11-19T00:39:12.650092+0000","last_fullsized":"2023-11-19T00:39:12.650092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649416+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:39:12.649416+0000","last_peered":"2023-11-19T00:39:12.649416+0000","last_clean":"2023-11-19T00:39:12.649416+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:39:12.649416+0000","last_undegraded":"2023-11-19T00:39:12.649416+0000","last_fullsized":"2023-11-19T00:39:12.649416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649915+0000","last_change":"2023-11-19T00:38:44.774042+0000","last_active":"2023-11-19T00:39:12.649915+0000","last_peered":"2023-11-19T00:39:12.649915+0000","last_clean":"2023-11-19T00:39:12.649915+0000","last_became_active":"2023-11-19T00:38:44.773418+0000","last_became_peered":"2023-11-19T00:38:44.773418+0000","last_unstale":"2023-11-19T00:39:12.649915+0000","last_undegraded":"2023-11-19T00:39:12.649915+0000","last_fullsized":"2023-11-19T00:39:12.649915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650797+0000","last_change":"2023-11-19T00:38:44.777450+0000","last_active":"2023-11-19T00:39:12.650797+0000","last_peered":"2023-11-19T00:39:12.650797+0000","last_clean":"2023-11-19T00:39:12.650797+0000","last_became_active":"2023-11-19T00:38:44.777084+0000","last_became_peered":"2023-11-19T00:38:44.777084+0000","last_unstale":"2023-11-19T00:39:12.650797+0000","last_undegraded":"2023-11-19T00:39:12.650797+0000","last_fullsized":"2023-11-19T00:39:12.650797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650150+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:39:12.650150+0000","last_peered":"2023-11-19T00:39:12.650150+0000","last_clean":"2023-11-19T00:39:12.650150+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:39:12.650150+0000","last_undegraded":"2023-11-19T00:39:12.650150+0000","last_fullsized":"2023-11-19T00:39:12.650150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817958+0000","last_change":"2023-11-19T00:38:44.781147+0000","last_active":"2023-11-19T00:39:12.817958+0000","last_peered":"2023-11-19T00:39:12.817958+0000","last_clean":"2023-11-19T00:39:12.817958+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:39:12.817958+0000","last_undegraded":"2023-11-19T00:39:12.817958+0000","last_fullsized":"2023-11-19T00:39:12.817958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650500+0000","last_change":"2023-11-19T00:38:44.772710+0000","last_active":"2023-11-19T00:39:12.650500+0000","last_peered":"2023-11-19T00:39:12.650500+0000","last_clean":"2023-11-19T00:39:12.650500+0000","last_became_active":"2023-11-19T00:38:44.772181+0000","last_became_peered":"2023-11-19T00:38:44.772181+0000","last_unstale":"2023-11-19T00:39:12.650500+0000","last_undegraded":"2023-11-19T00:39:12.650500+0000","last_fullsized":"2023-11-19T00:39:12.650500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649961+0000","last_change":"2023-11-19T00:38:44.771210+0000","last_active":"2023-11-19T00:39:12.649961+0000","last_peered":"2023-11-19T00:39:12.649961+0000","last_clean":"2023-11-19T00:39:12.649961+0000","last_became_active":"2023-11-19T00:38:44.770785+0000","last_became_peered":"2023-11-19T00:38:44.770785+0000","last_unstale":"2023-11-19T00:39:12.649961+0000","last_undegraded":"2023-11-19T00:39:12.649961+0000","last_fullsized":"2023-11-19T00:39:12.649961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:04:00.120798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650198+0000","last_change":"2023-11-19T00:38:44.776171+0000","last_active":"2023-11-19T00:39:12.650198+0000","last_peered":"2023-11-19T00:39:12.650198+0000","last_clean":"2023-11-19T00:39:12.650198+0000","last_became_active":"2023-11-19T00:38:44.775771+0000","last_became_peered":"2023-11-19T00:38:44.775771+0000","last_unstale":"2023-11-19T00:39:12.650198+0000","last_undegraded":"2023-11-19T00:39:12.650198+0000","last_fullsized":"2023-11-19T00:39:12.650198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649416+0000","last_change":"2023-11-19T00:38:44.771258+0000","last_active":"2023-11-19T00:39:12.649416+0000","last_peered":"2023-11-19T00:39:12.649416+0000","last_clean":"2023-11-19T00:39:12.649416+0000","last_became_active":"2023-11-19T00:38:44.770632+0000","last_became_peered":"2023-11-19T00:38:44.770632+0000","last_unstale":"2023-11-19T00:39:12.649416+0000","last_undegraded":"2023-11-19T00:39:12.649416+0000","last_fullsized":"2023-11-19T00:39:12.649416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817516+0000","last_change":"2023-11-19T00:38:44.784234+0000","last_active":"2023-11-19T00:39:12.817516+0000","last_peered":"2023-11-19T00:39:12.817516+0000","last_clean":"2023-11-19T00:39:12.817516+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:39:12.817516+0000","last_undegraded":"2023-11-19T00:39:12.817516+0000","last_fullsized":"2023-11-19T00:39:12.817516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650481+0000","last_change":"2023-11-19T00:38:44.773681+0000","last_active":"2023-11-19T00:39:12.650481+0000","last_peered":"2023-11-19T00:39:12.650481+0000","last_clean":"2023-11-19T00:39:12.650481+0000","last_became_active":"2023-11-19T00:38:44.772746+0000","last_became_peered":"2023-11-19T00:38:44.772746+0000","last_unstale":"2023-11-19T00:39:12.650481+0000","last_undegraded":"2023-11-19T00:39:12.650481+0000","last_fullsized":"2023-11-19T00:39:12.650481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818079+0000","last_change":"2023-11-19T00:38:43.776968+0000","last_active":"2023-11-19T00:39:12.818079+0000","last_peered":"2023-11-19T00:39:12.818079+0000","last_clean":"2023-11-19T00:39:12.818079+0000","last_became_active":"2023-11-19T00:38:43.776668+0000","last_became_peered":"2023-11-19T00:38:43.776668+0000","last_unstale":"2023-11-19T00:39:12.818079+0000","last_undegraded":"2023-11-19T00:39:12.818079+0000","last_fullsized":"2023-11-19T00:39:12.818079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650673+0000","last_change":"2023-11-19T00:38:44.771867+0000","last_active":"2023-11-19T00:39:12.650673+0000","last_peered":"2023-11-19T00:39:12.650673+0000","last_clean":"2023-11-19T00:39:12.650673+0000","last_became_active":"2023-11-19T00:38:44.771545+0000","last_became_peered":"2023-11-19T00:38:44.771545+0000","last_unstale":"2023-11-19T00:39:12.650673+0000","last_undegraded":"2023-11-19T00:39:12.650673+0000","last_fullsized":"2023-11-19T00:39:12.650673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649734+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:39:12.649734+0000","last_peered":"2023-11-19T00:39:12.649734+0000","last_clean":"2023-11-19T00:39:12.649734+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:39:12.649734+0000","last_undegraded":"2023-11-19T00:39:12.649734+0000","last_fullsized":"2023-11-19T00:39:12.649734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650238+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:39:12.650238+0000","last_peered":"2023-11-19T00:39:12.650238+0000","last_clean":"2023-11-19T00:39:12.650238+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:39:12.650238+0000","last_undegraded":"2023-11-19T00:39:12.650238+0000","last_fullsized":"2023-11-19T00:39:12.650238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650277+0000","last_change":"2023-11-19T00:38:43.775960+0000","last_active":"2023-11-19T00:39:12.650277+0000","last_peered":"2023-11-19T00:39:12.650277+0000","last_clean":"2023-11-19T00:39:12.650277+0000","last_became_active":"2023-11-19T00:38:43.775413+0000","last_became_peered":"2023-11-19T00:38:43.775413+0000","last_unstale":"2023-11-19T00:39:12.650277+0000","last_undegraded":"2023-11-19T00:39:12.650277+0000","last_fullsized":"2023-11-19T00:39:12.650277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650152+0000","last_change":"2023-11-19T00:38:44.773267+0000","last_active":"2023-11-19T00:39:12.650152+0000","last_peered":"2023-11-19T00:39:12.650152+0000","last_clean":"2023-11-19T00:39:12.650152+0000","last_became_active":"2023-11-19T00:38:44.772893+0000","last_became_peered":"2023-11-19T00:38:44.772893+0000","last_unstale":"2023-11-19T00:39:12.650152+0000","last_undegraded":"2023-11-19T00:39:12.650152+0000","last_fullsized":"2023-11-19T00:39:12.650152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:55.267655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817582+0000","last_change":"2023-11-19T00:38:43.778785+0000","last_active":"2023-11-19T00:39:12.817582+0000","last_peered":"2023-11-19T00:39:12.817582+0000","last_clean":"2023-11-19T00:39:12.817582+0000","last_became_active":"2023-11-19T00:38:43.778467+0000","last_became_peered":"2023-11-19T00:38:43.778467+0000","last_unstale":"2023-11-19T00:39:12.817582+0000","last_undegraded":"2023-11-19T00:39:12.817582+0000","last_fullsized":"2023-11-19T00:39:12.817582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:43.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818326+0000","last_change":"2023-11-19T00:38:43.778787+0000","last_active":"2023-11-19T00:39:12.818326+0000","last_peered":"2023-11-19T00:39:12.818326+0000","last_clean":"2023-11-19T00:39:12.818326+0000","last_became_active":"2023-11-19T00:38:43.778474+0000","last_became_peered":"2023-11-19T00:38:43.778474+0000","last_unstale":"2023-11-19T00:39:12.818326+0000","last_undegraded":"2023-11-19T00:39:12.818326+0000","last_fullsized":"2023-11-19T00:39:12.818326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:24.670566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649961+0000","last_change":"2023-11-19T00:38:44.778501+0000","last_active":"2023-11-19T00:39:12.649961+0000","last_peered":"2023-11-19T00:39:12.649961+0000","last_clean":"2023-11-19T00:39:12.649961+0000","last_became_active":"2023-11-19T00:38:44.778166+0000","last_became_peered":"2023-11-19T00:38:44.778166+0000","last_unstale":"2023-11-19T00:39:12.649961+0000","last_undegraded":"2023-11-19T00:39:12.649961+0000","last_fullsized":"2023-11-19T00:39:12.649961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650665+0000","last_change":"2023-11-19T00:38:43.775968+0000","last_active":"2023-11-19T00:39:12.650665+0000","last_peered":"2023-11-19T00:39:12.650665+0000","last_clean":"2023-11-19T00:39:12.650665+0000","last_became_active":"2023-11-19T00:38:43.775438+0000","last_became_peered":"2023-11-19T00:38:43.775438+0000","last_unstale":"2023-11-19T00:39:12.650665+0000","last_undegraded":"2023-11-19T00:39:12.650665+0000","last_fullsized":"2023-11-19T00:39:12.650665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650224+0000","last_change":"2023-11-19T00:38:44.774241+0000","last_active":"2023-11-19T00:39:12.650224+0000","last_peered":"2023-11-19T00:39:12.650224+0000","last_clean":"2023-11-19T00:39:12.650224+0000","last_became_active":"2023-11-19T00:38:44.773457+0000","last_became_peered":"2023-11-19T00:38:44.773457+0000","last_unstale":"2023-11-19T00:39:12.650224+0000","last_undegraded":"2023-11-19T00:39:12.650224+0000","last_fullsized":"2023-11-19T00:39:12.650224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:30.626520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818266+0000","last_change":"2023-11-19T00:38:43.778767+0000","last_active":"2023-11-19T00:39:12.818266+0000","last_peered":"2023-11-19T00:39:12.818266+0000","last_clean":"2023-11-19T00:39:12.818266+0000","last_became_active":"2023-11-19T00:38:43.778464+0000","last_became_peered":"2023-11-19T00:38:43.778464+0000","last_unstale":"2023-11-19T00:39:12.818266+0000","last_undegraded":"2023-11-19T00:39:12.818266+0000","last_fullsized":"2023-11-19T00:39:12.818266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:23.880795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817659+0000","last_change":"2023-11-19T00:38:44.782191+0000","last_active":"2023-11-19T00:39:12.817659+0000","last_peered":"2023-11-19T00:39:12.817659+0000","last_clean":"2023-11-19T00:39:12.817659+0000","last_became_active":"2023-11-19T00:38:44.781807+0000","last_became_peered":"2023-11-19T00:38:44.781807+0000","last_unstale":"2023-11-19T00:39:12.817659+0000","last_undegraded":"2023-11-19T00:39:12.817659+0000","last_fullsized":"2023-11-19T00:39:12.817659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:07:28.322317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818048+0000","last_change":"2023-11-19T00:38:43.777982+0000","last_active":"2023-11-19T00:39:12.818048+0000","last_peered":"2023-11-19T00:39:12.818048+0000","last_clean":"2023-11-19T00:39:12.818048+0000","last_became_active":"2023-11-19T00:38:43.777735+0000","last_became_peered":"2023-11-19T00:38:43.777735+0000","last_unstale":"2023-11-19T00:39:12.818048+0000","last_undegraded":"2023-11-19T00:39:12.818048+0000","last_fullsized":"2023-11-19T00:39:12.818048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649893+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:39:12.649893+0000","last_peered":"2023-11-19T00:39:12.649893+0000","last_clean":"2023-11-19T00:39:12.649893+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:39:12.649893+0000","last_undegraded":"2023-11-19T00:39:12.649893+0000","last_fullsized":"2023-11-19T00:39:12.649893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650069+0000","last_change":"2023-11-19T00:38:43.775268+0000","last_active":"2023-11-19T00:39:12.650069+0000","last_peered":"2023-11-19T00:39:12.650069+0000","last_clean":"2023-11-19T00:39:12.650069+0000","last_became_active":"2023-11-19T00:38:43.774979+0000","last_became_peered":"2023-11-19T00:38:43.774979+0000","last_unstale":"2023-11-19T00:39:12.650069+0000","last_undegraded":"2023-11-19T00:39:12.650069+0000","last_fullsized":"2023-11-19T00:39:12.650069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817895+0000","last_change":"2023-11-19T00:38:44.784264+0000","last_active":"2023-11-19T00:39:12.817895+0000","last_peered":"2023-11-19T00:39:12.817895+0000","last_clean":"2023-11-19T00:39:12.817895+0000","last_became_active":"2023-11-19T00:38:44.783514+0000","last_became_peered":"2023-11-19T00:38:44.783514+0000","last_unstale":"2023-11-19T00:39:12.817895+0000","last_undegraded":"2023-11-19T00:39:12.817895+0000","last_fullsized":"2023-11-19T00:39:12.817895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:43:56.454230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817738+0000","last_change":"2023-11-19T00:38:43.777222+0000","last_active":"2023-11-19T00:39:12.817738+0000","last_peered":"2023-11-19T00:39:12.817738+0000","last_clean":"2023-11-19T00:39:12.817738+0000","last_became_active":"2023-11-19T00:38:43.776875+0000","last_became_peered":"2023-11-19T00:38:43.776875+0000","last_unstale":"2023-11-19T00:39:12.817738+0000","last_undegraded":"2023-11-19T00:39:12.817738+0000","last_fullsized":"2023-11-19T00:39:12.817738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:09:30.026523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818104+0000","last_change":"2023-11-19T00:38:44.781532+0000","last_active":"2023-11-19T00:39:12.818104+0000","last_peered":"2023-11-19T00:39:12.818104+0000","last_clean":"2023-11-19T00:39:12.818104+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:39:12.818104+0000","last_undegraded":"2023-11-19T00:39:12.818104+0000","last_fullsized":"2023-11-19T00:39:12.818104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:05.857021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650302+0000","last_change":"2023-11-19T00:38:43.775400+0000","last_active":"2023-11-19T00:39:12.650302+0000","last_peered":"2023-11-19T00:39:12.650302+0000","last_clean":"2023-11-19T00:39:12.650302+0000","last_became_active":"2023-11-19T00:38:43.774232+0000","last_became_peered":"2023-11-19T00:38:43.774232+0000","last_unstale":"2023-11-19T00:39:12.650302+0000","last_undegraded":"2023-11-19T00:39:12.650302+0000","last_fullsized":"2023-11-19T00:39:12.650302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818108+0000","last_change":"2023-11-19T00:38:44.780018+0000","last_active":"2023-11-19T00:39:12.818108+0000","last_peered":"2023-11-19T00:39:12.818108+0000","last_clean":"2023-11-19T00:39:12.818108+0000","last_became_active":"2023-11-19T00:38:44.779490+0000","last_became_peered":"2023-11-19T00:38:44.779490+0000","last_unstale":"2023-11-19T00:39:12.818108+0000","last_undegraded":"2023-11-19T00:39:12.818108+0000","last_fullsized":"2023-11-19T00:39:12.818108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:31:40.832623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649991+0000","last_change":"2023-11-19T00:38:43.773003+0000","last_active":"2023-11-19T00:39:12.649991+0000","last_peered":"2023-11-19T00:39:12.649991+0000","last_clean":"2023-11-19T00:39:12.649991+0000","last_became_active":"2023-11-19T00:38:43.771743+0000","last_became_peered":"2023-11-19T00:38:43.771743+0000","last_unstale":"2023-11-19T00:39:12.649991+0000","last_undegraded":"2023-11-19T00:39:12.649991+0000","last_fullsized":"2023-11-19T00:39:12.649991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650187+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:39:12.650187+0000","last_peered":"2023-11-19T00:39:12.650187+0000","last_clean":"2023-11-19T00:39:12.650187+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:39:12.650187+0000","last_undegraded":"2023-11-19T00:39:12.650187+0000","last_fullsized":"2023-11-19T00:39:12.650187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":218,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817860+0000","last_change":"2023-11-19T00:38:35.666042+0000","last_active":"2023-11-19T00:39:12.817860+0000","last_peered":"2023-11-19T00:39:12.817860+0000","last_clean":"2023-11-19T00:39:12.817860+0000","last_became_active":"2023-11-19T00:38:35.665077+0000","last_became_peered":"2023-11-19T00:38:35.665077+0000","last_unstale":"2023-11-19T00:39:12.817860+0000","last_undegraded":"2023-11-19T00:39:12.817860+0000","last_fullsized":"2023-11-19T00:39:12.817860+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:38.251250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818194+0000","last_change":"2023-11-19T00:38:39.750407+0000","last_active":"2023-11-19T00:39:12.818194+0000","last_peered":"2023-11-19T00:39:12.818194+0000","last_clean":"2023-11-19T00:39:12.818194+0000","last_became_active":"2023-11-19T00:38:39.750115+0000","last_became_peered":"2023-11-19T00:38:39.750115+0000","last_unstale":"2023-11-19T00:39:12.818194+0000","last_undegraded":"2023-11-19T00:39:12.818194+0000","last_fullsized":"2023-11-19T00:39:12.818194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:43.828985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649833+0000","last_change":"2023-11-19T00:38:43.775141+0000","last_active":"2023-11-19T00:39:12.649833+0000","last_peered":"2023-11-19T00:39:12.649833+0000","last_clean":"2023-11-19T00:39:12.649833+0000","last_became_active":"2023-11-19T00:38:43.774369+0000","last_became_peered":"2023-11-19T00:38:43.774369+0000","last_unstale":"2023-11-19T00:39:12.649833+0000","last_undegraded":"2023-11-19T00:39:12.649833+0000","last_fullsized":"2023-11-19T00:39:12.649833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:01:16.679330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818208+0000","last_change":"2023-11-19T00:38:44.781716+0000","last_active":"2023-11-19T00:39:12.818208+0000","last_peered":"2023-11-19T00:39:12.818208+0000","last_clean":"2023-11-19T00:39:12.818208+0000","last_became_active":"2023-11-19T00:38:44.780962+0000","last_became_peered":"2023-11-19T00:38:44.780962+0000","last_unstale":"2023-11-19T00:39:12.818208+0000","last_undegraded":"2023-11-19T00:39:12.818208+0000","last_fullsized":"2023-11-19T00:39:12.818208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:39.804556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817767+0000","last_change":"2023-11-19T00:38:39.747988+0000","last_active":"2023-11-19T00:39:12.817767+0000","last_peered":"2023-11-19T00:39:12.817767+0000","last_clean":"2023-11-19T00:39:12.817767+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:39:12.817767+0000","last_undegraded":"2023-11-19T00:39:12.817767+0000","last_fullsized":"2023-11-19T00:39:12.817767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:19:05.231918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649628+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:39:12.649628+0000","last_peered":"2023-11-19T00:39:12.649628+0000","last_clean":"2023-11-19T00:39:12.649628+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:39:12.649628+0000","last_undegraded":"2023-11-19T00:39:12.649628+0000","last_fullsized":"2023-11-19T00:39:12.649628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650582+0000","last_change":"2023-11-19T00:38:44.774308+0000","last_active":"2023-11-19T00:39:12.650582+0000","last_peered":"2023-11-19T00:39:12.650582+0000","last_clean":"2023-11-19T00:39:12.650582+0000","last_became_active":"2023-11-19T00:38:44.773620+0000","last_became_peered":"2023-11-19T00:38:44.773620+0000","last_unstale":"2023-11-19T00:39:12.650582+0000","last_undegraded":"2023-11-19T00:39:12.650582+0000","last_fullsized":"2023-11-19T00:39:12.650582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:18:02.415456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649751+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:39:12.649751+0000","last_peered":"2023-11-19T00:39:12.649751+0000","last_clean":"2023-11-19T00:39:12.649751+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:39:12.649751+0000","last_undegraded":"2023-11-19T00:39:12.649751+0000","last_fullsized":"2023-11-19T00:39:12.649751+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650049+0000","last_change":"2023-11-19T00:38:43.773306+0000","last_active":"2023-11-19T00:39:12.650049+0000","last_peered":"2023-11-19T00:39:12.650049+0000","last_clean":"2023-11-19T00:39:12.650049+0000","last_became_active":"2023-11-19T00:38:43.773006+0000","last_became_peered":"2023-11-19T00:38:43.773006+0000","last_unstale":"2023-11-19T00:39:12.650049+0000","last_undegraded":"2023-11-19T00:39:12.650049+0000","last_fullsized":"2023-11-19T00:39:12.650049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650224+0000","last_change":"2023-11-19T00:38:44.776477+0000","last_active":"2023-11-19T00:39:12.650224+0000","last_peered":"2023-11-19T00:39:12.650224+0000","last_clean":"2023-11-19T00:39:12.650224+0000","last_became_active":"2023-11-19T00:38:44.775612+0000","last_became_peered":"2023-11-19T00:38:44.775612+0000","last_unstale":"2023-11-19T00:39:12.650224+0000","last_undegraded":"2023-11-19T00:39:12.650224+0000","last_fullsized":"2023-11-19T00:39:12.650224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817822+0000","last_change":"2023-11-19T00:38:39.750364+0000","last_active":"2023-11-19T00:39:12.817822+0000","last_peered":"2023-11-19T00:39:12.817822+0000","last_clean":"2023-11-19T00:39:12.817822+0000","last_became_active":"2023-11-19T00:38:39.750083+0000","last_became_peered":"2023-11-19T00:38:39.750083+0000","last_unstale":"2023-11-19T00:39:12.817822+0000","last_undegraded":"2023-11-19T00:39:12.817822+0000","last_fullsized":"2023-11-19T00:39:12.817822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:59:12.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818175+0000","last_change":"2023-11-19T00:38:43.777981+0000","last_active":"2023-11-19T00:39:12.818175+0000","last_peered":"2023-11-19T00:39:12.818175+0000","last_clean":"2023-11-19T00:39:12.818175+0000","last_became_active":"2023-11-19T00:38:43.777721+0000","last_became_peered":"2023-11-19T00:38:43.777721+0000","last_unstale":"2023-11-19T00:39:12.818175+0000","last_undegraded":"2023-11-19T00:39:12.818175+0000","last_fullsized":"2023-11-19T00:39:12.818175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:37:29.622435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650042+0000","last_change":"2023-11-19T00:38:44.774583+0000","last_active":"2023-11-19T00:39:12.650042+0000","last_peered":"2023-11-19T00:39:12.650042+0000","last_clean":"2023-11-19T00:39:12.650042+0000","last_became_active":"2023-11-19T00:38:44.773998+0000","last_became_peered":"2023-11-19T00:38:44.773998+0000","last_unstale":"2023-11-19T00:39:12.650042+0000","last_undegraded":"2023-11-19T00:39:12.650042+0000","last_fullsized":"2023-11-19T00:39:12.650042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818320+0000","last_change":"2023-11-19T00:38:43.777041+0000","last_active":"2023-11-19T00:39:12.818320+0000","last_peered":"2023-11-19T00:39:12.818320+0000","last_clean":"2023-11-19T00:39:12.818320+0000","last_became_active":"2023-11-19T00:38:43.776737+0000","last_became_peered":"2023-11-19T00:38:43.776737+0000","last_unstale":"2023-11-19T00:39:12.818320+0000","last_undegraded":"2023-11-19T00:39:12.818320+0000","last_fullsized":"2023-11-19T00:39:12.818320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:29.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650123+0000","last_change":"2023-11-19T00:38:39.746275+0000","last_active":"2023-11-19T00:39:12.650123+0000","last_peered":"2023-11-19T00:39:12.650123+0000","last_clean":"2023-11-19T00:39:12.650123+0000","last_became_active":"2023-11-19T00:38:39.745886+0000","last_became_peered":"2023-11-19T00:38:39.745886+0000","last_unstale":"2023-11-19T00:39:12.650123+0000","last_undegraded":"2023-11-19T00:39:12.650123+0000","last_fullsized":"2023-11-19T00:39:12.650123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:07:25.126092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650115+0000","last_change":"2023-11-19T00:38:44.776063+0000","last_active":"2023-11-19T00:39:12.650115+0000","last_peered":"2023-11-19T00:39:12.650115+0000","last_clean":"2023-11-19T00:39:12.650115+0000","last_became_active":"2023-11-19T00:38:44.775675+0000","last_became_peered":"2023-11-19T00:38:44.775675+0000","last_unstale":"2023-11-19T00:39:12.650115+0000","last_undegraded":"2023-11-19T00:39:12.650115+0000","last_fullsized":"2023-11-19T00:39:12.650115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650097+0000","last_change":"2023-11-19T00:38:43.774563+0000","last_active":"2023-11-19T00:39:12.650097+0000","last_peered":"2023-11-19T00:39:12.650097+0000","last_clean":"2023-11-19T00:39:12.650097+0000","last_became_active":"2023-11-19T00:38:43.774185+0000","last_became_peered":"2023-11-19T00:38:43.774185+0000","last_unstale":"2023-11-19T00:39:12.650097+0000","last_undegraded":"2023-11-19T00:39:12.650097+0000","last_fullsized":"2023-11-19T00:39:12.650097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:50.184703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650872+0000","last_change":"2023-11-19T00:38:39.748941+0000","last_active":"2023-11-19T00:39:12.650872+0000","last_peered":"2023-11-19T00:39:12.650872+0000","last_clean":"2023-11-19T00:39:12.650872+0000","last_became_active":"2023-11-19T00:38:39.748679+0000","last_became_peered":"2023-11-19T00:38:39.748679+0000","last_unstale":"2023-11-19T00:39:12.650872+0000","last_undegraded":"2023-11-19T00:39:12.650872+0000","last_fullsized":"2023-11-19T00:39:12.650872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650353+0000","last_change":"2023-11-19T00:38:44.778561+0000","last_active":"2023-11-19T00:39:12.650353+0000","last_peered":"2023-11-19T00:39:12.650353+0000","last_clean":"2023-11-19T00:39:12.650353+0000","last_became_active":"2023-11-19T00:38:44.778201+0000","last_became_peered":"2023-11-19T00:38:44.778201+0000","last_unstale":"2023-11-19T00:39:12.650353+0000","last_undegraded":"2023-11-19T00:39:12.650353+0000","last_fullsized":"2023-11-19T00:39:12.650353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:33:46.037359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650382+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:39:12.650382+0000","last_peered":"2023-11-19T00:39:12.650382+0000","last_clean":"2023-11-19T00:39:12.650382+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:39:12.650382+0000","last_undegraded":"2023-11-19T00:39:12.650382+0000","last_fullsized":"2023-11-19T00:39:12.650382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650320+0000","last_change":"2023-11-19T00:38:39.746220+0000","last_active":"2023-11-19T00:39:12.650320+0000","last_peered":"2023-11-19T00:39:12.650320+0000","last_clean":"2023-11-19T00:39:12.650320+0000","last_became_active":"2023-11-19T00:38:39.745845+0000","last_became_peered":"2023-11-19T00:38:39.745845+0000","last_unstale":"2023-11-19T00:39:12.650320+0000","last_undegraded":"2023-11-19T00:39:12.650320+0000","last_fullsized":"2023-11-19T00:39:12.650320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:04.251428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649576+0000","last_change":"2023-11-19T00:38:44.778739+0000","last_active":"2023-11-19T00:39:12.649576+0000","last_peered":"2023-11-19T00:39:12.649576+0000","last_clean":"2023-11-19T00:39:12.649576+0000","last_became_active":"2023-11-19T00:38:44.777911+0000","last_became_peered":"2023-11-19T00:38:44.777911+0000","last_unstale":"2023-11-19T00:39:12.649576+0000","last_undegraded":"2023-11-19T00:39:12.649576+0000","last_fullsized":"2023-11-19T00:39:12.649576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:14.851263+0000","last_change":"2023-11-19T00:38:43.776164+0000","last_active":"2023-11-19T00:39:14.851263+0000","last_peered":"2023-11-19T00:39:14.851263+0000","last_clean":"2023-11-19T00:39:14.851263+0000","last_became_active":"2023-11-19T00:38:43.775677+0000","last_became_peered":"2023-11-19T00:38:43.775677+0000","last_unstale":"2023-11-19T00:39:14.851263+0000","last_undegraded":"2023-11-19T00:39:14.851263+0000","last_fullsized":"2023-11-19T00:39:14.851263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:37.708461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818347+0000","last_change":"2023-11-19T00:38:39.748039+0000","last_active":"2023-11-19T00:39:12.818347+0000","last_peered":"2023-11-19T00:39:12.818347+0000","last_clean":"2023-11-19T00:39:12.818347+0000","last_became_active":"2023-11-19T00:38:39.747743+0000","last_became_peered":"2023-11-19T00:38:39.747743+0000","last_unstale":"2023-11-19T00:39:12.818347+0000","last_undegraded":"2023-11-19T00:39:12.818347+0000","last_fullsized":"2023-11-19T00:39:12.818347+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:19.427221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650044+0000","last_change":"2023-11-19T00:38:44.776225+0000","last_active":"2023-11-19T00:39:12.650044+0000","last_peered":"2023-11-19T00:39:12.650044+0000","last_clean":"2023-11-19T00:39:12.650044+0000","last_became_active":"2023-11-19T00:38:44.775727+0000","last_became_peered":"2023-11-19T00:38:44.775727+0000","last_unstale":"2023-11-19T00:39:12.650044+0000","last_undegraded":"2023-11-19T00:39:12.650044+0000","last_fullsized":"2023-11-19T00:39:12.650044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817812+0000","last_change":"2023-11-19T00:38:44.780245+0000","last_active":"2023-11-19T00:39:12.817812+0000","last_peered":"2023-11-19T00:39:12.817812+0000","last_clean":"2023-11-19T00:39:12.817812+0000","last_became_active":"2023-11-19T00:38:44.779410+0000","last_became_peered":"2023-11-19T00:38:44.779410+0000","last_unstale":"2023-11-19T00:39:12.817812+0000","last_undegraded":"2023-11-19T00:39:12.817812+0000","last_fullsized":"2023-11-19T00:39:12.817812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"22'10","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:14.851038+0000","last_change":"2023-11-19T00:38:43.778713+0000","last_active":"2023-11-19T00:39:14.851038+0000","last_peered":"2023-11-19T00:39:14.851038+0000","last_clean":"2023-11-19T00:39:14.851038+0000","last_became_active":"2023-11-19T00:38:43.778400+0000","last_became_peered":"2023-11-19T00:38:43.778400+0000","last_unstale":"2023-11-19T00:39:14.851038+0000","last_undegraded":"2023-11-19T00:39:14.851038+0000","last_fullsized":"2023-11-19T00:39:14.851038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649582+0000","last_change":"2023-11-19T00:38:44.774432+0000","last_active":"2023-11-19T00:39:12.649582+0000","last_peered":"2023-11-19T00:39:12.649582+0000","last_clean":"2023-11-19T00:39:12.649582+0000","last_became_active":"2023-11-19T00:38:44.773918+0000","last_became_peered":"2023-11-19T00:38:44.773918+0000","last_unstale":"2023-11-19T00:39:12.649582+0000","last_undegraded":"2023-11-19T00:39:12.649582+0000","last_fullsized":"2023-11-19T00:39:12.649582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:25:24.884880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650813+0000","last_change":"2023-11-19T00:38:43.773372+0000","last_active":"2023-11-19T00:39:12.650813+0000","last_peered":"2023-11-19T00:39:12.650813+0000","last_clean":"2023-11-19T00:39:12.650813+0000","last_became_active":"2023-11-19T00:38:43.772994+0000","last_became_peered":"2023-11-19T00:38:43.772994+0000","last_unstale":"2023-11-19T00:39:12.650813+0000","last_undegraded":"2023-11-19T00:39:12.650813+0000","last_fullsized":"2023-11-19T00:39:12.650813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.818190+0000","last_change":"2023-11-19T00:38:43.777277+0000","last_active":"2023-11-19T00:39:12.818190+0000","last_peered":"2023-11-19T00:39:12.818190+0000","last_clean":"2023-11-19T00:39:12.818190+0000","last_became_active":"2023-11-19T00:38:43.776964+0000","last_became_peered":"2023-11-19T00:38:43.776964+0000","last_unstale":"2023-11-19T00:39:12.818190+0000","last_undegraded":"2023-11-19T00:39:12.818190+0000","last_fullsized":"2023-11-19T00:39:12.818190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649537+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:39:12.649537+0000","last_peered":"2023-11-19T00:39:12.649537+0000","last_clean":"2023-11-19T00:39:12.649537+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:39:12.649537+0000","last_undegraded":"2023-11-19T00:39:12.649537+0000","last_fullsized":"2023-11-19T00:39:12.649537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650349+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:39:12.650349+0000","last_peered":"2023-11-19T00:39:12.650349+0000","last_clean":"2023-11-19T00:39:12.650349+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:39:12.650349+0000","last_undegraded":"2023-11-19T00:39:12.650349+0000","last_fullsized":"2023-11-19T00:39:12.650349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649487+0000","last_change":"2023-11-19T00:38:44.774931+0000","last_active":"2023-11-19T00:39:12.649487+0000","last_peered":"2023-11-19T00:39:12.649487+0000","last_clean":"2023-11-19T00:39:12.649487+0000","last_became_active":"2023-11-19T00:38:44.774619+0000","last_became_peered":"2023-11-19T00:38:44.774619+0000","last_unstale":"2023-11-19T00:39:12.649487+0000","last_undegraded":"2023-11-19T00:39:12.649487+0000","last_fullsized":"2023-11-19T00:39:12.649487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:29:52.949622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650866+0000","last_change":"2023-11-19T00:38:44.775954+0000","last_active":"2023-11-19T00:39:12.650866+0000","last_peered":"2023-11-19T00:39:12.650866+0000","last_clean":"2023-11-19T00:39:12.650866+0000","last_became_active":"2023-11-19T00:38:44.775409+0000","last_became_peered":"2023-11-19T00:38:44.775409+0000","last_unstale":"2023-11-19T00:39:12.650866+0000","last_undegraded":"2023-11-19T00:39:12.650866+0000","last_fullsized":"2023-11-19T00:39:12.650866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:10.901362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649584+0000","last_change":"2023-11-19T00:38:43.774832+0000","last_active":"2023-11-19T00:39:12.649584+0000","last_peered":"2023-11-19T00:39:12.649584+0000","last_clean":"2023-11-19T00:39:12.649584+0000","last_became_active":"2023-11-19T00:38:43.774270+0000","last_became_peered":"2023-11-19T00:38:43.774270+0000","last_unstale":"2023-11-19T00:39:12.649584+0000","last_undegraded":"2023-11-19T00:39:12.649584+0000","last_fullsized":"2023-11-19T00:39:12.649584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:08.659642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650058+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:39:12.650058+0000","last_peered":"2023-11-19T00:39:12.650058+0000","last_clean":"2023-11-19T00:39:12.650058+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:39:12.650058+0000","last_undegraded":"2023-11-19T00:39:12.650058+0000","last_fullsized":"2023-11-19T00:39:12.650058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.649573+0000","last_change":"2023-11-19T00:38:43.768405+0000","last_active":"2023-11-19T00:39:12.649573+0000","last_peered":"2023-11-19T00:39:12.649573+0000","last_clean":"2023-11-19T00:39:12.649573+0000","last_became_active":"2023-11-19T00:38:43.768158+0000","last_became_peered":"2023-11-19T00:38:43.768158+0000","last_unstale":"2023-11-19T00:39:12.649573+0000","last_undegraded":"2023-11-19T00:39:12.649573+0000","last_fullsized":"2023-11-19T00:39:12.649573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650643+0000","last_change":"2023-11-19T00:38:44.772772+0000","last_active":"2023-11-19T00:39:12.650643+0000","last_peered":"2023-11-19T00:39:12.650643+0000","last_clean":"2023-11-19T00:39:12.650643+0000","last_became_active":"2023-11-19T00:38:44.772218+0000","last_became_peered":"2023-11-19T00:38:44.772218+0000","last_unstale":"2023-11-19T00:39:12.650643+0000","last_undegraded":"2023-11-19T00:39:12.650643+0000","last_fullsized":"2023-11-19T00:39:12.650643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650253+0000","last_change":"2023-11-19T00:38:43.776327+0000","last_active":"2023-11-19T00:39:12.650253+0000","last_peered":"2023-11-19T00:39:12.650253+0000","last_clean":"2023-11-19T00:39:12.650253+0000","last_became_active":"2023-11-19T00:38:43.776103+0000","last_became_peered":"2023-11-19T00:38:43.776103+0000","last_unstale":"2023-11-19T00:39:12.650253+0000","last_undegraded":"2023-11-19T00:39:12.650253+0000","last_fullsized":"2023-11-19T00:39:12.650253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:37.728262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650362+0000","last_change":"2023-11-19T00:38:44.771765+0000","last_active":"2023-11-19T00:39:12.650362+0000","last_peered":"2023-11-19T00:39:12.650362+0000","last_clean":"2023-11-19T00:39:12.650362+0000","last_became_active":"2023-11-19T00:38:44.771414+0000","last_became_peered":"2023-11-19T00:38:44.771414+0000","last_unstale":"2023-11-19T00:39:12.650362+0000","last_undegraded":"2023-11-19T00:39:12.650362+0000","last_fullsized":"2023-11-19T00:39:12.650362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650333+0000","last_change":"2023-11-19T00:38:43.774542+0000","last_active":"2023-11-19T00:39:12.650333+0000","last_peered":"2023-11-19T00:39:12.650333+0000","last_clean":"2023-11-19T00:39:12.650333+0000","last_became_active":"2023-11-19T00:38:43.774096+0000","last_became_peered":"2023-11-19T00:38:43.774096+0000","last_unstale":"2023-11-19T00:39:12.650333+0000","last_undegraded":"2023-11-19T00:39:12.650333+0000","last_fullsized":"2023-11-19T00:39:12.650333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:29:05.780512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817976+0000","last_change":"2023-11-19T00:38:44.784275+0000","last_active":"2023-11-19T00:39:12.817976+0000","last_peered":"2023-11-19T00:39:12.817976+0000","last_clean":"2023-11-19T00:39:12.817976+0000","last_became_active":"2023-11-19T00:38:44.783204+0000","last_became_peered":"2023-11-19T00:38:44.783204+0000","last_unstale":"2023-11-19T00:39:12.817976+0000","last_undegraded":"2023-11-19T00:39:12.817976+0000","last_fullsized":"2023-11-19T00:39:12.817976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:14.926453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817960+0000","last_change":"2023-11-19T00:38:43.776596+0000","last_active":"2023-11-19T00:39:12.817960+0000","last_peered":"2023-11-19T00:39:12.817960+0000","last_clean":"2023-11-19T00:39:12.817960+0000","last_became_active":"2023-11-19T00:38:43.776269+0000","last_became_peered":"2023-11-19T00:38:43.776269+0000","last_unstale":"2023-11-19T00:39:12.817960+0000","last_undegraded":"2023-11-19T00:39:12.817960+0000","last_fullsized":"2023-11-19T00:39:12.817960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:32:10.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817721+0000","last_change":"2023-11-19T00:38:44.783599+0000","last_active":"2023-11-19T00:39:12.817721+0000","last_peered":"2023-11-19T00:39:12.817721+0000","last_clean":"2023-11-19T00:39:12.817721+0000","last_became_active":"2023-11-19T00:38:44.782704+0000","last_became_peered":"2023-11-19T00:38:44.782704+0000","last_unstale":"2023-11-19T00:39:12.817721+0000","last_undegraded":"2023-11-19T00:39:12.817721+0000","last_fullsized":"2023-11-19T00:39:12.817721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:08.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650731+0000","last_change":"2023-11-19T00:38:43.773485+0000","last_active":"2023-11-19T00:39:12.650731+0000","last_peered":"2023-11-19T00:39:12.650731+0000","last_clean":"2023-11-19T00:39:12.650731+0000","last_became_active":"2023-11-19T00:38:43.773181+0000","last_became_peered":"2023-11-19T00:38:43.773181+0000","last_unstale":"2023-11-19T00:39:12.650731+0000","last_undegraded":"2023-11-19T00:39:12.650731+0000","last_fullsized":"2023-11-19T00:39:12.650731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:04:57.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650372+0000","last_change":"2023-11-19T00:38:44.771621+0000","last_active":"2023-11-19T00:39:12.650372+0000","last_peered":"2023-11-19T00:39:12.650372+0000","last_clean":"2023-11-19T00:39:12.650372+0000","last_became_active":"2023-11-19T00:38:44.771303+0000","last_became_peered":"2023-11-19T00:38:44.771303+0000","last_unstale":"2023-11-19T00:39:12.650372+0000","last_undegraded":"2023-11-19T00:39:12.650372+0000","last_fullsized":"2023-11-19T00:39:12.650372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650244+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:39:12.650244+0000","last_peered":"2023-11-19T00:39:12.650244+0000","last_clean":"2023-11-19T00:39:12.650244+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:39:12.650244+0000","last_undegraded":"2023-11-19T00:39:12.650244+0000","last_fullsized":"2023-11-19T00:39:12.650244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.817740+0000","last_change":"2023-11-19T00:38:44.784389+0000","last_active":"2023-11-19T00:39:12.817740+0000","last_peered":"2023-11-19T00:39:12.817740+0000","last_clean":"2023-11-19T00:39:12.817740+0000","last_became_active":"2023-11-19T00:38:44.784031+0000","last_became_peered":"2023-11-19T00:38:44.784031+0000","last_unstale":"2023-11-19T00:39:12.817740+0000","last_undegraded":"2023-11-19T00:39:12.817740+0000","last_fullsized":"2023-11-19T00:39:12.817740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:13:13.341883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-19T00:39:12.650264+0000","last_change":"2023-11-19T00:38:43.775635+0000","last_active":"2023-11-19T00:39:12.650264+0000","last_peered":"2023-11-19T00:39:12.650264+0000","last_clean":"2023-11-19T00:39:12.650264+0000","last_became_active":"2023-11-19T00:38:43.775203+0000","last_became_peered":"2023-11-19T00:38:43.775203+0000","last_unstale":"2023-11-19T00:39:12.650264+0000","last_undegraded":"2023-11-19T00:39:12.650264+0000","last_fullsized":"2023-11-19T00:39:12.650264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:44:26.103107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7350,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":74893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":819200,"data_stored":667783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":671379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:39:18.835 INFO:tasks.thrashosds.thrasher:Setting 3.2 to [2, 1] 2023-11-19T00:39:18.835 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.2', '2', '1'] 2023-11-19T00:39:18.835 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.2 2 1 2023-11-19T00:39:18.910 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:18.909+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:18.936 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:18.936 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:18.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:18.936 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:18.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.937 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:18.937 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:18.937 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.303192906, 2023-11-19T00:39:18.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:18.937 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.937 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:18.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:18.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:18.938 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:18.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.938 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:18.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:18.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:18.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:18.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:18.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:18.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:18.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:18.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:18.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:18.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:18.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:18.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:18.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:18.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:18.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:18.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:18.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:18.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:18.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:18.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:18.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:18.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:18.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:18.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:18.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:18.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:18.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:18.949 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.949 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:18.949 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.950 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:18.950 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:18.950 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.777494128999997, 2023-11-19T00:39:18.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:18.950 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:18.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:18.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:18.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:18.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:18.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:18.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:18.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:18.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:18.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:18.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:18.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:18.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:18.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:18.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:18.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:18.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:18.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:18.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:18.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:18.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:18.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:18.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:18.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:18.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:18.960 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.960 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.777380313000002, 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:18.961 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.962 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.962 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:18.962 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:18.962 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:18.962 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:18.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:18.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:18.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:18.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:18.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.777354922999997, 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.969 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:18.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:18.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:18.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.376579196000002, 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:18.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:18.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:18.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.165775853, 2023-11-19T00:39:18.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:18.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:18.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:18.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.988 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.165285134999998, 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:18.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:18.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:18.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:18.995 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.165232512000003, 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:18.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:18.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:18.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:19.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.002 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163756063000001, 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:19.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:19.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:19.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163711804000002, 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.010 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:19.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:19.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:19.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.017 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163669400000003, 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:19.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.024 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163622558999997, 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:19.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:19.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:19.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:19.032 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163551312000003, 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.037 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:19.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163354876, 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:19.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:19.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163303124999999, 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:19.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:19.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163097676, 2023-11-19T00:39:19.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:19.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:19.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:19.061 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.163046739999999, 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:19.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:19.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:19.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.068 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.162608358, 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:19.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:19.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.075 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.162571229999998, 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:19.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:19.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.162510445999999, 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:19.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:19.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:19.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:19.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:19.087 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:19.089 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:19.088+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:19.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:19.190 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:19.189+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:19.202 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:19.202 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:19.202 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:19.202 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:19.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:19.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:19.291 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:19.290+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:19.315 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:19.315 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:19.315 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:19.316 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:19.316 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:19.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:19.351 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:19.370 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:19.370 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:19.388 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:19.388 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:19.391 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:19.391+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:19.430 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:19.430 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:19.438 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:19.492 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:19.491+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:19.555 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:19.555 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:19.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:19.593 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:19.592+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:19.668 INFO:teuthology.orchestra.run.smithi046.stderr:set 3.2 pg_upmap mapping to [2,1] 2023-11-19T00:39:19.694 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:19.693+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:19.720 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:19.795 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:19.794+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:19.825 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:19.825 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:19.834 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:19.896 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:19.895+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:19.945 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:19.945 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:19.954 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:19.996 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:19.996+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.068 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:20.097 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:20.097+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:20.172 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.172 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:20.198 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:20.197+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:20.293 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.293 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.298 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:20.297+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:20.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:20.399 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:20.398+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:20.406 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.406 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:20.500 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:20.499+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:20.518 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.518 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.527 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:20.601 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:20.600+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:20.640 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.640 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:20.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:39:20.702 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:20.701+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:20.794 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.794 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:20.803 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:20.802+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:20.904 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:20.903+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:20.908 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:20.908 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:20.917 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:21.004 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:21.004+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:21.028 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:21.028 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:21.037 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:21.105 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:21.105+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:21.182 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:21.183 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:21.191 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:21.234 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:21.234+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:21.296 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:21.296 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:21.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:21.306 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:21.305+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:21.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:21.407 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:21.406+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:21.421 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:21.421 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:21.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:21.507 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:21.507+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:21.535 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:21.535 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:21.554 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:21.554 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:21.572 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:21.576 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:21.577 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:21.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:21.608 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:21.608+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:21.680 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:39:21.691 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.919826332, 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918833566000004, 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918773176999998, 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918721054000002, 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918675376000003, 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918648451000003, 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918620480999998, 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918593682999997, 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918562934000001, 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.918541677999997, 2023-11-19T00:39:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.912483885999997, 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.912434169999997, 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.911919482000002, 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.911557744, 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.911268806999999, 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.908834472000002, 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.908805927000003, 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.841194365, 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.840710391, 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.8405544740000002, 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:21.796 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:21.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:21.798 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:21.797+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:21.898 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:21.897+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:21.914 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:21.914 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:21.914 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:21.915 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:21.924 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:21.999 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:21.999+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:22.029 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:22.030 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:22.030 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:22.030 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:22.030 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:22.038 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:22.101 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:22.100+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:22.147 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.439375376999998, 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.438766207999997, 2023-11-19T00:39:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.583153848999999, 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:22.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:22.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:22.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:22.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.164 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.377360777, 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:22.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:22.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:22.171 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.376677782999998, 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:22.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:22.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.178 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.376630890999998, 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:22.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:22.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:22.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.376591171999998, 2023-11-19T00:39:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:22.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:22.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:22.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:22.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.193 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.193 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:22.193 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.376536850999997, 2023-11-19T00:39:22.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:22.193 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.193 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:22.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.376476183999998, 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:22.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:22.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.376350279, 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:22.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.376322096000003, 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:22.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.364291369999997, 2023-11-19T00:39:22.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:22.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.364245343, 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:22.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.364211724, 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:22.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.364164965000001, 2023-11-19T00:39:22.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:22.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.363944889999999, 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.235 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:22.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:22.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.363821512999998, 2023-11-19T00:39:22.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:22.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:22.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.363645194999997, 2023-11-19T00:39:22.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:22.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:22.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:22.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.361951068000003, 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:22.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.360899295999999, 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:22.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:22.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:22.260 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:22.260 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:22.261 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:22.260+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:22.261 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:22.363 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:22.362+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:22.378 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:22.378 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:22.387 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:22.465 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:22.464+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:22.492 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:22.492 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:22.492 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:22.492 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:22.492 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:22.501 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:22.565 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:22.565+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:22.609 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:22.609 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:22.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:22.610 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:22.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.610 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:22.610 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:22.610 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.976967594000001, 2023-11-19T00:39:22.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:22.611 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.611 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:22.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:22.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:22.611 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:22.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:22.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:22.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:22.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:22.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:22.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:22.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:22.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:22.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:22.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:22.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:22.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:22.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:22.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.621 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.451268816999999, 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:22.622 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:22.623 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:22.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.623 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:22.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:22.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:22.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:22.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:22.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:22.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:22.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.451155000999997, 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:22.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:22.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:22.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:22.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:22.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:22.638 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.451129610999999, 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:22.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:22.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.050353884000003, 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.645 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:22.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.839550541000001, 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:22.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:22.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:22.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:22.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:22.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.839059822999999, 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.659 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:22.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.665 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.839007199999998, 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.666 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:22.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:22.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:22.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:22.674 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.674 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.674 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.674 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.674 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:22.675 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.837530751000003, 2023-11-19T00:39:22.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:22.675 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.675 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.675 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:22.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:22.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:22.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:22.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:22.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:22.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:22.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:22.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:22.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:22.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:22.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:22.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:22.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:22.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.685 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.837486491999996, 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:22.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:22.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.837444087999998, 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.693 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:22.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.700 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:22.701 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.837397246999998, 2023-11-19T00:39:22.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:22.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.701 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.701 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:22.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:22.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:22.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.837325999999997, 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.708 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:22.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:22.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.837129564000001, 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.715 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:22.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:22.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:22.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:22.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:22.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.723 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.723 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:22.723 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.837077813000001, 2023-11-19T00:39:22.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:22.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.724 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.724 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:22.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:22.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:22.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:22.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:22.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:22.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:22.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:22.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:22.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:22.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:22.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:22.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:22.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:22.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:22.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:22.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:22.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.836872364000001, 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:22.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:22.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:22.803 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.836821428, 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:22.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:22.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:22.810 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.836383046000002, 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:22.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:22.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:22.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.836345917999999, 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:22.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:22.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.836285134000001, 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:22.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:22.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:22.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:22.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:22.829 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:22.829 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:22.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:22.831 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:22.829+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:22.930 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:22.930+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:22.947 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:22.947 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:22.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:23.031 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:23.031+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:23.103 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:23.103 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:23.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:23.132 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:23.131+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:23.217 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.445393418000002, 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444400651999999, 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444340263000001, 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444288139999998, 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444242461999998, 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444215536999998, 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444187567, 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444160769, 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444130020000003, 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.444108763999999, 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.438050971999999, 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.438001256, 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.437486567999997, 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.437124830000002, 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.436835893000001, 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.434401557999998, 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.434373012999998, 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.366761451000002, 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.366277477000001, 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.3661215599999998, 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:23.326 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:23.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:23.328 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:23.327+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:23.428 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:23.428+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:23.443 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:23.443 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:23.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:23.529 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:23.529+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:23.557 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:23.557 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:23.566 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:23.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:23.630 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:23.630+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:23.672 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.964419436999997, 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.963810268000003, 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.108197908999998, 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.902404836999999, 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.901721842999997, 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.901674950999997, 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.901635231999997, 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.901580911000003, 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.901520243999997, 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:23.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.901394338999999, 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.901366156000002, 2023-11-19T00:39:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.889335430000003, 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.889289402999999, 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.889255783999999, 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.889209025, 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.888988949999998, 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.888865572999997, 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.888689255000003, 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.886995128000002, 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.885943355999999, 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:23.781 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:23.782 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:23.783 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:23.783 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:23.784 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:23.784 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:23.782+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:23.785 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:23.785 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:23.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:39:23.884 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:23.883+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:23.902 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:23.902 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:23.911 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:23.986 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:23.985+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:24.017 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.017 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:24.026 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:24.087 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:24.087+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:24.170 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.171 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:24.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:24.224 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:24.223+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:24.290 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:24.290+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:24.294 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.294 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:24.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:24.390 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:24.390+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:24.448 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.448 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:24.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:24.491 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:24.491+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:24.562 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.562 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:24.570 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:24.615 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:24.615+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:24.683 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:24.683 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:24.683 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-11-19T00:39:24.684 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:39:24.684 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:39:24.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-11-19T00:39:24.685 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:39:24.686 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.686 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:24.692 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:24.692+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:24.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:24.789 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:24.789 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2023-11-19T00:39:24.790 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:24.793 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:24.793+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:24.844 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.844 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:24.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:24.894 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:24.894+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:24.995 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:24.994+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:24.998 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:24.998 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.010 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:25.095 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:25.095+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:25.126 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.126 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.134 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:25.196 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:25.196+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:25.240 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.240 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.249 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:25.297 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:25.296+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:25.354 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.355 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:25.397 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:25.396+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:25.473 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.473 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:25.498 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:25.497+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:25.586 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.586 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:25.598 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:25.598+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:25.699 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.699 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.699 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:25.698+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:25.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:25.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:25.800 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:25.800+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:25.817 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.817 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.826 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:25.901 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:25.900+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:25.917 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:25.918 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:25.932 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:25.932 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:25.936 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:25.936 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:25.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:25.954 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:25.954 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:26.001 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:26.000+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.340784501999998, 2023-11-19T00:39:26.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:26.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.340175332999998, 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:26.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.484562973999999, 2023-11-19T00:39:26.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:26.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:26.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:26.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.065 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.278769902000001, 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:26.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.278086907999999, 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:26.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:26.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.278040015999999, 2023-11-19T00:39:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:26.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.084 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.278000296999998, 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:26.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:26.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:26.091 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.277945975999998, 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:26.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:26.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:26.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.277885308999998, 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:26.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:26.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.277759404000001, 2023-11-19T00:39:26.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:26.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:26.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:26.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.277731221000003, 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:26.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.265700494999997, 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:26.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:26.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:26.120 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.265654468000001, 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:26.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:26.125 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.265620849000001, 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:26.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:26.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:26.130 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.265574090000001, 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:26.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.265354015, 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:26.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:26.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.265230637999998, 2023-11-19T00:39:26.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:26.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.265054319999997, 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.146 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:26.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.263360192999997, 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:26.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:26.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.262308421, 2023-11-19T00:39:26.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:26.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:26.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:26.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:26.161 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:26.163 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:26.163 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:26.162+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:26.264 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:26.263+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:26.273 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:26.274 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:26.274 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:26.274 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:26.283 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:26.364 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:26.364+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:26.429 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:26.429 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:26.429 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:26.429 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:26.429 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:26.438 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:26.481 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:26.481+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 51.913823465999997, 2023-11-19T00:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.388124689000001, 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.388010872999999, 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.387985483000001, 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.987209755999999, 2023-11-19T00:39:26.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:26.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:26.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:26.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.776406412999997, 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.582 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:26.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:26.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.775915695000002, 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.589 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:26.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:26.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.596 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.775863072, 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:26.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.603 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.774386622999998, 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:26.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:26.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:26.610 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.774342363999999, 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.611 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:26.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:26.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.77429996, 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:26.618 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:26.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:26.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.625 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.774253119000001, 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:26.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:26.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:26.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:26.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:26.633 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.774181872, 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:26.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:26.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.773985435999997, 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:26.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:26.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:26.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:26.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:26.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:26.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:26.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.773933685000003, 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.650 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:26.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:26.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.773728235999997, 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:26.657 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.773677300000003, 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:26.664 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:26.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:26.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:26.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:26.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:26.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.773238917999997, 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.672 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:26.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.773201790000002, 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:26.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:26.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:26.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:26.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.773141006000003, 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:26.693 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:26.692+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:26.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:26.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:39:26.794 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:26.793+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:26.809 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:26.810 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:26.810 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:26.810 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:26.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:26.895 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:26.894+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:26.924 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:26.925 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:26.925 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:26.925 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:26.925 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:26.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:27.018 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:27.017+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:27.081 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.309510928000002, 2023-11-19T00:39:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308518161999999, 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:27.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308457773000001, 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.096 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:27.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:27.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308405649999997, 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:27.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:27.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:27.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:27.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.111 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308359971999998, 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:27.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:27.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:27.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:27.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:27.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:27.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308333046999998, 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:27.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:27.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:27.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:27.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308305077, 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.127 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:27.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:27.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:27.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308278279, 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308247530000003, 2023-11-19T00:39:27.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.308226273999999, 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:27.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:27.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.302168481999999, 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:27.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.157 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.302118766, 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:27.158 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:27.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:27.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:27.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.163 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.301604077999997, 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:27.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:27.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:27.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:27.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:27.169 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.301242340000002, 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:27.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:27.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.300953403000001, 2023-11-19T00:39:27.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:27.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:27.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.180 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.298519067999997, 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.186 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.298490522999998, 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:27.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:27.192 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 37.230878961000002, 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:27.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:27.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.230394987, 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.199 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:27.206 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.23023907, 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:27.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:27.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:27.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:27.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:27.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:27.213 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:27.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:27.216 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:27.214+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:27.316 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:27.315+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:27.334 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:27.334 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:27.343 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:27.417 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:27.417+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:27.490 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:27.490 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:27.490 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:27.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:27.542 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:27.542+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:27.605 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.897340186000001, 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:27.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:27.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.896731017, 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:27.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:27.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.615 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.041118658000002, 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:27.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:27.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.835325586000003, 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:27.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:27.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:27.627 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.834642592000002, 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:27.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.834595700000001, 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:27.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:27.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.640 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.641 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:27.641 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.834555981000001, 2023-11-19T00:39:27.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:27.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.641 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.642 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:27.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:27.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:27.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.834501660000001, 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:27.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:27.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:27.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:27.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:27.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:27.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:27.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:27.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:27.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:27.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:27.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:27.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:27.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.658 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.658 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.658 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:27.659 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.834440993000001, 2023-11-19T00:39:27.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:27.659 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.659 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.659 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:27.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:27.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:27.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:27.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:27.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.834315087999997, 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:27.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.834286904999999, 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:27.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.822256179, 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:27.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.822210151999997, 2023-11-19T00:39:27.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:27.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:27.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.822176532999997, 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:27.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.822129773999997, 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:27.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:27.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.821909699000003, 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:27.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.821786322000001, 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:27.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.821610004, 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.819915877, 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.818864105000003, 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:27.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:27.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:27.724 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:27.726 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:39:27.726 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:27.727 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:27.725+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:27.826 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:27.826+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:27.843 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:27.843 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:27.844 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:27.844 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:27.853 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:27.927 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:27.926+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:27.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:27.998 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:27.998 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:27.998 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:27.999 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:27.999 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:28.008 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:28.028 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:28.028+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:28.115 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:28.115 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:28.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:28.115 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:28.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.116 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:28.116 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:28.116 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.482882877999998, 2023-11-19T00:39:28.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:28.116 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.116 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.116 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:28.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:28.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:28.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:28.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:28.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:28.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:28.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:28.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 51.957184101000003, 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.126 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:28.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:28.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 51.957070285, 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.133 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:28.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:28.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.139 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 51.957044895000003, 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:28.140 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:28.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:28.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:28.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:28.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 51.556269168, 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:28.147 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:28.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:28.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.345465824999998, 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:28.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:28.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.344975107000003, 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.161 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:28.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:28.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.168 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.344922484000001, 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:28.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:28.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:28.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:28.176 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.343446034999999, 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:28.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:28.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.183 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.343401776, 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:28.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:28.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.343359372000002, 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.191 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:28.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.343312531000002, 2023-11-19T00:39:28.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:28.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:28.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:28.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.205 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.343241284000001, 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:28.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:28.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.343044847999998, 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:28.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:28.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.342993096999997, 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:28.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:28.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.342787647999998, 2023-11-19T00:39:28.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:28.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:28.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:28.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.234 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.342736711999997, 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:28.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:28.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:28.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.242 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.342298329999998, 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:28.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:28.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.342261202000003, 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:28.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:28.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:28.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.342200417999997, 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:28.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:28.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:28.262 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:28.263 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:28.264 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:28.264 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:28.265 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:28.265 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:28.263+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:28.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:28.266 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:28.364 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:28.364+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:28.383 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:28.383 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:28.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:28.465 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:28.464+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:28.497 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:28.497 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:28.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:28.565 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:28.565+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:28.611 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:28.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:28.666 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:28.665+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:28.734 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:28.734 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:28.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:28.767 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:28.766+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:28.868 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:28.867+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:28.892 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:28.892 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:28.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:28.968 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:28.968+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:29.007 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.008 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.016 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:29.069 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:29.069+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:29.130 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.130 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.139 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:29.170 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:29.169+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:29.244 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.244 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.253 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:29.297 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:29.296+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:29.358 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.358 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:29.409 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:29.409+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:29.473 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:29.472+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:29.481 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.481 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:29.574 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:29.574+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:29.633 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.633 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:29.687 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:29.686+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:29.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:39:29.747 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.748 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:29.798 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:29.799 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:29.799 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-11-19T00:39:29.799 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:39:29.799 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:39:29.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-11-19T00:39:29.801 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:29.799+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:29.868 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.868 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.876 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:29.876+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:29.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:29.910 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:29.910 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2023-11-19T00:39:29.910 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:29.977 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:29.977+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:29.983 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:29.983 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:29.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:30.078 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:30.078+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:30.097 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:30.098 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:30.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:30.179 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:30.178+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:30.215 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:30.216 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:30.225 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:30.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:30.280 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:30.280+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:30.369 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:30.369 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:30.378 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:30.380 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:30.380+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:30.471 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:30.472 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:30.481 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:30.481+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:30.482 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:30.483 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:30.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:30.504 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:30.504 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:30.536 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:30.537 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:30.582 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:30.582+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:30.605 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:30.605 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:30.605 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:30.605 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:30.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:30.683 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:30.682+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:30.692 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:39:30.722 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:30.722 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:30.722 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:30.722 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:30.722 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:30.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:30.784 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:30.783+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:30.839 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:30.839 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:30.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:30.840 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:30.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.840 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:30.840 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:30.841 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.067653018999998, 2023-11-19T00:39:30.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:30.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.842 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:30.842 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:30.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:30.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066660253000002, 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.847 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:30.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:30.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:30.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:30.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:30.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:30.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:30.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066599863999997, 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.861 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066547741000001, 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:30.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:30.867 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066502063000001, 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:30.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:30.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:30.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:30.875 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066475138000001, 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:30.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:30.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.881 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066447168000003, 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:30.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:30.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:30.888 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066420370000003, 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:30.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:30.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066389620999999, 2023-11-19T00:39:30.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:30.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:30.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:30.898 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.066368365000002, 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:30.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.060310573000002, 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:30.903 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:30.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.907 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.060260857000003, 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:30.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:30.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.059746169, 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:30.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.917 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.059384430999998, 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:30.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.059095493999997, 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:30.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:30.928 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.056661159000001, 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:30.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:30.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:30.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.933 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.056632614000002, 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:30.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.989021051999998, 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:30.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:30.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 20.988537078, 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:30.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.988381161, 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:30.956 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:30.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:30.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:30.963 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:30.965 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:30.965 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:30.964+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:31.066 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:31.066+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:31.081 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:31.082 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:31.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:31.167 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:31.167+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:31.195 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:31.196 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:31.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:31.268 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:31.268+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:31.310 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:31.310 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:31.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:31.310 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:31.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.602365952, 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:31.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:31.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:31.316 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.601756782999999, 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:31.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.321 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.746144424000001, 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:31.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:31.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.540351352000002, 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:31.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:31.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:31.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.539668358, 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:31.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.539621466, 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:31.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:31.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.349 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.349 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:31.349 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.539581747, 2023-11-19T00:39:31.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:31.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:31.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:31.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:31.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:31.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.539527425999999, 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.356 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:31.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.539466759, 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:31.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:31.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.539340854000002, 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:31.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:31.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:31.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:31.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.375 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.539312670999998, 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:31.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:31.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:31.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:31.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.527281944999999, 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:31.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:31.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.527235918000002, 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.386 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.391 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.527202299000002, 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:31.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.396 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.527155540000003, 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:31.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.526935465000001, 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:31.402 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:31.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.526812088, 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:31.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.526635769999999, 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.412 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:31.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.524941642999998, 2023-11-19T00:39:31.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:31.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:31.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:31.422 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.523889871000002, 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:31.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:31.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:31.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:31.427 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:31.429 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:31.429 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:31.428+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:31.530 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:31.529+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:31.539 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:31.539 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:31.539 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:31.539 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:31.548 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:31.630 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:31.630+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:31.652 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:31.652 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:31.660 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:31.732 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:31.732+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:31.768 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:31.769 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:31.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:31.769 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:31.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.770 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:31.770 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:31.770 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.135855108999998, 2023-11-19T00:39:31.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:31.771 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.771 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.771 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:31.771 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:31.771 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:31.772 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:31.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.772 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:31.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:31.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:31.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:31.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:31.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:31.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:31.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:31.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:31.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:31.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:31.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:31.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:31.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:31.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:31.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:31.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:31.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:31.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:31.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:31.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:31.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:31.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.785 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:31.785 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:31.785 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 55.610156332000003, 2023-11-19T00:39:31.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:31.786 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.786 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.786 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:31.786 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:31.786 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:31.786 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:31.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.787 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:31.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:31.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:31.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:31.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:31.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:31.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:31.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:31.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:31.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:31.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:31.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:31.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:31.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:31.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:31.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:31.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:31.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.796 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.796 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:31.796 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:31.797 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 55.610042516, 2023-11-19T00:39:31.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:31.797 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.797 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.797 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:31.797 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:31.797 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:31.798 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:31.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.798 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:31.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:31.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:31.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:31.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:31.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:31.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:31.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:31.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:31.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:31.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:31.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:31.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 55.610017126000002, 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:31.807 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 55.209241399, 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.998438055999998, 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.997947338000003, 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:31.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:31.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:31.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:31.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:31.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:31.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:31.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.997894715000001, 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.837 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:31.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:31.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:31.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.996418265999999, 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.845 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:31.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:31.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.851 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.996374007, 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:31.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:31.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.859 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:31.860 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.996331603000002, 2023-11-19T00:39:31.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:31.860 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.860 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.860 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:31.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:31.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:31.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:31.866 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.996284762000002, 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:31.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:31.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:31.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:31.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.996213515000001, 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:31.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:31.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.996017078999998, 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:31.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:31.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:31.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.995965327999997, 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.888 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:31.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:31.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:31.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.995759878999998, 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.895 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:31.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:31.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:31.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.995708942999997, 2023-11-19T00:39:31.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:31.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.995270560999998, 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.909 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:31.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:31.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.916 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.995233433000003, 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:31.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:31.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.924 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:31.924 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:31.924 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.995172648999997, 2023-11-19T00:39:31.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:31.924 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:31.925 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:31.925 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:31.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:31.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:31.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:31.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:31.931 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:31.931 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:31.932 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:31.931+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:31.932 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:32.032 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:32.032+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:32.049 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:32.049 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:32.049 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:32.049 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:32.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:32.133 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:32.133+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:32.164 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:32.164 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:32.164 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:32.165 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:32.165 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:32.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:32.234 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:32.233+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:32.318 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:32.319 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.547012635999998, 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.546019870000002, 2023-11-19T00:39:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:32.326 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:32.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:32.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:32.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.333 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545959480999997, 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:32.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:32.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545907358000001, 2023-11-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.343 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:32.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:32.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545861680000002, 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:32.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:32.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545834755000001, 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:32.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:32.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545806785000003, 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:32.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:32.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:32.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:32.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:32.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:32.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:32.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:32.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.370 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.370 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:32.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:32.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:32.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:32.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:32.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:32.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:32.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:32.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:32.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:32.376 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.376 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.376 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.376 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.377 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:32.377 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545779987000003, 2023-11-19T00:39:32.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:32.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:32.377 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:32.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:32.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:32.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:32.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:32.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:32.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:32.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:32.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:32.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:32.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:32.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:32.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:32.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:32.384 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.385 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.385 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.385 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.386 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:32.386 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545749237999999, 2023-11-19T00:39:32.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:32.386 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.386 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:32.386 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:32.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:32.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:32.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:32.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:32.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:32.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:32.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:32.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:32.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:32.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:32.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:32.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:32.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:32.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:32.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:32.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.394 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.545727982000002, 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:32.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:32.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:32.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:32.399 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.539670190000002, 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:32.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:32.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.539620474000003, 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:32.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:32.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.539105786, 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:32.409 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.410 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.410 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:32.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:32.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:32.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:32.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:32.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:32.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:32.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:32.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:32.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:32.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.415 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:32.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:32.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.416 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.416 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:32.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:32.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:32.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:32.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:32.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:32.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.418 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.538744047999998, 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:32.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:32.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:32.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:32.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:32.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:32.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:32.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.424 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.424 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:32.424 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:32.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.424 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.425 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:32.425 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:32.425 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.538455110999998, 2023-11-19T00:39:32.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:32.426 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.426 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.426 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:32.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:32.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:32.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:32.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:32.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:32.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.430 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.430 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:32.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:32.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.431 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.431 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:32.431 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:32.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:32.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:32.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:32.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:32.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:32.436 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.536020776000001, 2023-11-19T00:39:32.436 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:32.436 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.436 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.436 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.436 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.437 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:32.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:32.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:32.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:32.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:32.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.442 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.442 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:32.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:32.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:32.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:32.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:32.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:32.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.444 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.445 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:32.445 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:32.445 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.535992231000002, 2023-11-19T00:39:32.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.468380668999998, 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:32.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:32.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:32.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:32.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:32.457 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.457 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.467896695, 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:32.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:32.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.464 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.467740778, 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:32.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:32.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:32.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:32.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:32.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:32.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:32.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:32.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:32.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:32.472 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:32.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:32.474 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:32.473+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:32.552 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:32.574 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:32.573+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:32.591 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:32.592 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:32.592 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:32.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:32.675 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:32.674+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:32.692 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:32.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:39:32.711 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:32.712 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:32.740 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:32.747 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:32.747 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:32.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:32.801 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:32.800+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:32.862 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:32.863 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:32.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:32.913 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:32.912+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:32.978 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:32.978+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:32.988 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:32.989 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:32.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:33.079 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:33.079+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:33.104 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.104 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.113 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:33.180 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:33.180+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:33.257 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.258 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:33.281 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:33.281+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:33.379 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.380 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.382 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:33.381+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:33.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:33.483 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:33.482+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:33.493 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.493 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:33.583 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:33.583+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:33.607 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.607 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:33.684 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:33.684+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:33.702 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:39:33.728 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.728 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:33.785 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:33.785+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.850 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:33.886 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:33.886+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:33.954 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:33.955 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:33.964 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:34.010 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:34.009+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:34.079 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.079 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.089 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:34.090 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:34.087+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:34.189 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:34.188+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:34.235 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.235 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.244 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:34.289 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:34.289+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:34.349 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.349 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:34.390 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:34.390+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:34.474 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.474 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.483 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:34.491 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:34.490+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:34.588 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.588 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.591 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:34.591+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:34.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:34.692 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:34.692+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:34.702 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.702 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.711 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:34.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:34.793 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:34.792+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:34.829 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.829 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.837 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:34.919 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:34.919 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:34.919 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-11-19T00:39:34.919 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:39:34.920 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:39:34.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-11-19T00:39:34.922 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:34.921+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:34.959 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:34.960 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:34.984 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:34.984 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:34.993 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:34.994 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:35.025 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:35.025 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "" 2023-11-19T00:39:35.025 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:35.026 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:35.026 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:35.036 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:35.035+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:35.096 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:35.095+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:35.141 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:35.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.433288638999997, 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.142 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:35.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.432679469999997, 2023-11-19T00:39:35.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:35.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.577067110999998, 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:35.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:35.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:35.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.371274038999999, 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:35.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:35.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:35.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:35.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:35.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.370591044999998, 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:35.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:35.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:35.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:35.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:35.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.174 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.370544152999997, 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:35.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.370504433999997, 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:35.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:35.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.370450112999997, 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:35.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:35.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:35.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:35.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.370389445999997, 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:35.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:35.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.201 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.370263541, 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:35.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:35.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.370235358000002, 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.207 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:35.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:35.211 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.358204632000003, 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:35.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.358158605, 2023-11-19T00:39:35.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:35.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:35.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.221 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.358124986, 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:35.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:35.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:35.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:35.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:35.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.358078227, 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.231 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.235 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.357858151999999, 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:35.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.239 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.357734774999997, 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.240 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:35.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.357558457000003, 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.245 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:35.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:35.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.355864330000003, 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.250 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:35.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.354812557999999, 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:35.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:35.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:35.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:35.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:35.260 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:35.262 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:35.262 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:35.261+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:35.362 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:35.362+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:35.379 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:35.379 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:35.379 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:35.379 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:35.388 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:35.464 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:35.463+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:35.493 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:35.493 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:35.493 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:35.493 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:35.493 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:35.502 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:35.564 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:35.563+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:35.609 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.977558858999998, 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.451860082000003, 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:35.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:35.624 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.451746266000001, 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.451720876000003, 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:35.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:35.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.637 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.050945149, 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:35.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:35.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.840141805999998, 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.644 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:35.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:35.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:35.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.839651087999997, 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.651 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.839598465000002, 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.838122016, 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.838077757000001, 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.838035353000002, 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.837988512000003, 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.837917265000002, 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.837720828999998, 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.837669077999998, 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.837463628999998, 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.837412692999997, 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.836974310999999, 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.836937183000003, 2023-11-19T00:39:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.836876398999998, 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:35.748 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:35.749 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:39:35.751 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:35.749+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:35.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:35.853 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:35.851+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:35.863 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:35.864 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:35.864 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:35.864 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:35.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:35.953 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:35.953+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:36.018 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:36.018 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:36.018 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:36.018 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:36.018 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:36.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:36.054 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:36.053+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:36.133 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.361578727000001, 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360585960999998, 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360525572, 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360473448999997, 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360427770999998, 2023-11-19T00:39:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360400845999997, 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360372876, 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360346077999999, 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:36.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.180 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360315329000002, 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:36.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.360294072999999, 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:36.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.354236280999999, 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:36.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:36.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.194 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.354186564999999, 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:36.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:36.199 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.353671876999996, 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:36.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.204 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.353310139000001, 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:36.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.353021202000001, 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:36.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:36.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:36.214 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.350586866999997, 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:36.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:36.219 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.350558321999998, 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:36.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:36.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:36.224 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.282946760000002, 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:36.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:36.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.282462786, 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:36.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:36.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.282306868999999, 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:36.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:36.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:36.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:36.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:36.243 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:36.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:36.245 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:36.244+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:36.346 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:36.345+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:36.360 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:36.360 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:36.361 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:36.361 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:36.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:36.447 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:36.446+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:36.475 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:36.476 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:36.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:36.547 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:36.547+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:36.631 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.923808221000002, 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.632 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:36.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.923199052000001, 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.637 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:36.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:36.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.067586693000003, 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.642 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:36.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:36.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.861793620999997, 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.647 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:36.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:36.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.861110627000002, 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:36.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:36.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.659 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.861063735000002, 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:36.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:36.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.861024016000002, 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:36.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:36.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:36.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.860969695000001, 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:36.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:36.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:36.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:36.679 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.860909028000002, 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:36.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.860783122999997, 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:36.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.86075494, 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:36.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.848724214000001, 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:36.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:36.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.848678186999997, 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.701 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:36.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:36.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.848644567999997, 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:36.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:36.710 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.848597808999997, 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:36.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.848377734000003, 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:36.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:36.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.848254357000002, 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.720 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:36.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:36.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.848078039000001, 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:36.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.846383912, 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:36.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:36.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.734 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.845332139999996, 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:36.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:36.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:36.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:36.740 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:36.740 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:39:36.742 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:36.743 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:36.741+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:36.843 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:36.842+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:36.860 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:36.860 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:36.861 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:36.861 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:36.870 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:36.943 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:36.943+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:36.976 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:36.976 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:36.976 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:36.976 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:36.976 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:36.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:37.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:37.044 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:37.044+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:37.092 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.460544683999998, 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.093 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:37.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:37.100 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.934845907000003, 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:37.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:37.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.106 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.934732091000001, 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:37.107 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:37.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:37.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.934706701000003, 2023-11-19T00:39:37.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:37.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:37.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.533930974, 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:37.120 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:37.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:37.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.323127630999998, 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:37.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:37.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:37.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.322636912999997, 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:37.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:37.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.322584290000002, 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:37.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:37.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:37.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.147 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.321107841, 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:37.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:37.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:37.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.321063582000001, 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:37.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:37.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:37.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.321021178000002, 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:37.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:37.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.320974337000003, 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.169 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:37.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:37.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:37.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.176 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.320903090000002, 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:37.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:37.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.183 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.320706653999999, 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:37.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:37.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:37.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:37.190 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.320654902999998, 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:37.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:37.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.320449453999998, 2023-11-19T00:39:37.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:37.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:37.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.205 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.320398517999998, 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:37.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:37.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.319960135999999, 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:37.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:37.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:37.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.319923008000004, 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:37.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:37.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.319862223999998, 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:37.227 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:37.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:37.232 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:37.233 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:37.234 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:37.234 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:37.235 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:37.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:37.235 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:37.233+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:37.256 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:37.256 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:37.335 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:37.334+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:37.348 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:37.348 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:37.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:37.435 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:37.435+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:37.461 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:37.461 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:37.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:37.536 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:37.535+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:37.576 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:37.576 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:37.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:37.637 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:37.636+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:37.700 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:37.701 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:37.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:37.737 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:37.737+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:37.815 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:37.815 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:37.823 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:37.838 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:37.838+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:37.928 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:37.928 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:37.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:37.938 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:37.937+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:38.039 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:38.040+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:38.053 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.053 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.063 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:38.140 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:38.141+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:38.169 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.169 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.177 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:38.242 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:38.241+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:38.282 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.283 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:38.343 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:38.342+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:38.401 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.401 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:38.444 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:38.443+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:38.544 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:38.544+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:38.554 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.554 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:38.646 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:38.646+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:38.668 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.668 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:38.744 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:39:38.746 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:38.745+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:38.790 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.790 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.799 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:38.848 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:38.847+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:38.946 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:38.947 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:38.949 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:38.949+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:38.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:39.050 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:39.049+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:39.060 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:39.060 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:39.069 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:39.151 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:39.150+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:39.179 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:39.179 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:39.187 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:39.252 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:39.251+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:39.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:39.293 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:39.294 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:39.302 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:39.353 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:39.352+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:39.407 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:39.407 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:39.407 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:39.408 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:39.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:39.426 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:39.426 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:39.443 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:39.444 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:39.456 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:39.456+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:39.529 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:39.529 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:39.529 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:39.529 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:39.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:39.554 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:39.553+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:39.643 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:39.644 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:39.644 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:39.644 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:39.644 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:39.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:39.655 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:39.654+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:39.719 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:39:39.756 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:39.755+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:39.759 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:39.759 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:39.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:39.759 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:39.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.987819350000002, 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:39.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:39.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.763 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986826583999999, 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:39.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:39.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986766195000001, 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.770 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:39.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986714071999998, 2023-11-19T00:39:39.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:39.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:39.782 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986668393999999, 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:39.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.788 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986641468999998, 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:39.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:39.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:39.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986613499000001, 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:39.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:39.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:39.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986586701, 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:39.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.805 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986555952000003, 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:39.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:39.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.986534696, 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:39.810 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:39.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.980476904, 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:39.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:39.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.980427188, 2023-11-19T00:39:39.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:39.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.979912499999998, 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:39.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:39.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.828 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.979550762000002, 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:39.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:39.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:39.833 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.979261825000002, 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:39.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.976827489999998, 2023-11-19T00:39:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:39.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.976798944999999, 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:39.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 49.909187383000003, 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.848 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:39.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:39.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.854 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.908703409000001, 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:39.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:39.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.908547492, 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:39.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:39.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:39.867 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:39.867 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:39.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:39.869 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:39.867+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:39.969 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:39.968+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:39.985 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:39.985 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:39.985 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:39.985 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:39.995 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:40.034 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:40.035 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:40.035 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-11-19T00:39:40.035 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:39:40.035 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:39:40.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-11-19T00:39:40.070 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:40.069+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:40.102 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:40.102 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:40.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:40.140 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:40.140 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "" 2023-11-19T00:39:40.141 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:40.171 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:40.170+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:40.257 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.549804193, 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:40.258 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:40.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.549195023999999, 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:40.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.693582665000001, 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:40.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:40.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:40.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:40.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:40.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:40.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:40.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.487789593000002, 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:40.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:40.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:40.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:40.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.487106599000001, 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.283 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:40.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.487059707, 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:40.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:40.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.487019988, 2023-11-19T00:39:40.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:40.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:40.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:40.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:40.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.304 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.486965667, 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:40.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:40.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.486905, 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.312 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:40.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.486779095000003, 2023-11-19T00:39:40.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:40.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:40.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:40.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:40.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:40.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.486750911999998, 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.474720185999999, 2023-11-19T00:39:40.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:40.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:40.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.474674159000003, 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:40.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:40.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.474640540000003, 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:40.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.474593781000003, 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.474373706000002, 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.474250329, 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.474074010999999, 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.472379883999999, 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.471328112000002, 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:40.386 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:40.388 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:40.388 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:40.386+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:40.489 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:40.488+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:40.500 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:40.500 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:40.500 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:40.500 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:40.511 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:40.590 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:40.590+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:40.658 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:40.658 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:40.667 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:40.691 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:40.691+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:40.773 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.141619472000002, 2023-11-19T00:39:40.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:40.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 64.615920695, 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:40.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:40.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:40.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 64.615806879000004, 2023-11-19T00:39:40.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:40.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:40.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 64.615781489, 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 64.215005762000004, 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.004202419000002, 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:40.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:40.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.003711701, 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:40.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:40.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.003659077999998, 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:40.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.002182629000004, 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:40.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:40.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:40.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.002138369999997, 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:40.843 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.002095965999999, 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:40.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.002049124999999, 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.851 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:40.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:40.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:40.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.001977877999998, 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:40.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:40.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:40.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.001781442000002, 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:40.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:40.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:40.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:40.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.001729691000001, 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:40.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:40.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:40.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.001524242000002, 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.880 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:40.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:40.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.887 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.001473306000001, 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:40.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:40.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.001034924000002, 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:40.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:40.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.000997796, 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.000937012000001, 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:40.914 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:40.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:40.916 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:40.915+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:41.016 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:41.016+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:41.030 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:41.030 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:41.030 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:41.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:41.117 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:41.116+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:41.144 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:41.144 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:41.144 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:41.144 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:41.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:41.219 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:41.218+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:41.298 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.527037984000003, 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.526045218, 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525984829000002, 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525932705999999, 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525887028, 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525860102999999, 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525832133000002, 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525805335000001, 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525774585999997, 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.525753330000001, 2023-11-19T00:39:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.519695538000001, 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.519645822000001, 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:41.363 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.519131133999998, 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:41.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:41.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.368 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.518769396000003, 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.518480459000003, 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:41.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:41.378 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.516046123999999, 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:41.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.516017579, 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.448406017000003, 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.447922042999998, 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:41.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.447766126000001, 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:41.408 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:41.409 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:41.410 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:41.409+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:41.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:41.510 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:41.510+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:41.522 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:41.522 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:41.522 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:41.522 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:41.531 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:41.593 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:41.611 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:41.610+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:41.611 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:41.630 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:41.630 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:41.636 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:41.636 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:41.646 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:41.712 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:41.711+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:41.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:39:41.750 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:41.750 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:41.760 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:41.813 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:41.812+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:41.874 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:41.874 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:41.883 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:41.913 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:41.912+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:41.988 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:41.989 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:41.997 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:42.014 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:42.013+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:42.103 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:42.103 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:42.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:42.115 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:42.114+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:42.216 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:42.215+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:42.228 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:42.228 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:42.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:42.317 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:42.317+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:42.385 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:42.385 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:42.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:42.419 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:42.419+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:42.498 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:42.498 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:42.506 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:42.550 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:42.549+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:42.616 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:42.616 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:42.620 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:42.620+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:42.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:42.722 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:42.721+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:42.726 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:39:42.771 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:42.771 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:42.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:42.823 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:42.822+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:42.924 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:42.924+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:42.925 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:42.925 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:42.934 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:43.026 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:43.025+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:43.051 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:43.051 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:43.060 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:43.127 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:43.126+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:43.166 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:43.166 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:43.174 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:43.230 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:43.229+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:43.279 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:43.280 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:43.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:43.331 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:43.330+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:43.393 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:43.394 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:43.403 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:43.432 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:43.432+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:43.533 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:43.533+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:43.548 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:43.549 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:43.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:43.634 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:43.634+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:43.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:43.664 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:43.664 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:43.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:43.735 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:43.734+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:43.788 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:43.788 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:43.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:43.808 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:43.809 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:43.836 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:43.835+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:43.841 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:43.841 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:43.872 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:43.872 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:43.901 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:43.902 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:43.911 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:43.955 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:43.954+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:44.017 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.309582382000002, 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.018 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:44.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:44.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.308973213000002, 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.023 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:44.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:44.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.453360853999996, 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.028 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:44.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:44.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.247567781999997, 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.033 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:44.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:44.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:44.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.246884788000003, 2023-11-19T00:39:44.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:44.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:44.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:44.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.246837896000002, 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:44.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:44.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:44.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.246798177000002, 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:44.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:44.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.246743856000002, 2023-11-19T00:39:44.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.246683189000002, 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.246557283999998, 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.246529101, 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.234498375000001, 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.234452347999998, 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.234418728999998, 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.234371969999998, 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.234151894999997, 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.234028518000002, 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.233852200000001, 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.232158073000001, 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.231106300999997, 2023-11-19T00:39:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:44.126 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:44.128 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:44.128 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:44.126+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:44.229 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:44.228+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:44.236 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:44.236 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:44.236 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:44.236 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:44.245 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:44.329 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:44.329+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:44.353 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:44.353 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:44.353 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:44.353 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:44.354 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:44.359 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:44.430 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:44.429+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.875665273999999, 2023-11-19T00:39:44.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:44.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:44.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.515 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 68.349966496999997, 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.517 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:44.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 68.349852681000002, 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:44.524 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:44.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 68.349827290999997, 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:44.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:44.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:44.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:44.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.949051564000001, 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.537 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.543 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.738248220999999, 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:44.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:44.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.550 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.737757502999997, 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:44.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.737704880000003, 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:44.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:44.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:44.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.736228431000001, 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:44.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:44.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:44.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.571 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.736184172000002, 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:44.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:44.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.736141768000003, 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:44.579 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:44.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:44.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.736094927000003, 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:44.586 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:44.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:44.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.736023680000002, 2023-11-19T00:39:44.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:44.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.735827243999999, 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.600 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:44.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:44.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:44.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.735775492999998, 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.607 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:44.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:44.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.735570043999999, 2023-11-19T00:39:44.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:44.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:44.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.735519107999998, 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.621 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:44.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:44.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.735080726, 2023-11-19T00:39:44.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:44.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:44.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:44.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.735043597999997, 2023-11-19T00:39:44.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:44.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:44.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:44.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.642 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.734982813999999, 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:44.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:44.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.647 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.648 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.648 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:44.648 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:44.648 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:44.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:44.650 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:44.648+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:44.744 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:39:44.750 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:44.749+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:44.765 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:44.766 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:44.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:44.851 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:44.849+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:44.880 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:44.880 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:44.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:44.952 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:44.951+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:45.033 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.261530241000003, 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260537475, 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260477086000002, 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260424962999998, 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260379284999999, 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260352359999999, 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260324390000001, 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260297592000001, 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260266842999997, 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.260245587, 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.254187795, 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.254138079000001, 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.253623390999998, 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.253261653000003, 2023-11-19T00:39:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.252972716000002, 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.250538380999998, 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.250509835999999, 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.182898274000003, 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 35.182414299999998, 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 30.182258383000001, 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:45.141 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:45.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:45.143 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:45.141+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:45.150 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:45.150 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:45.150 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-11-19T00:39:45.150 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:39:45.150 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:39:45.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-11-19T00:39:45.243 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:45.241+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:45.255 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:45.255 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "" 2023-11-19T00:39:45.255 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:45.260 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:45.260 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:45.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:45.260 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:45.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:45.344 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:45.343+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:45.374 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:45.374 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:45.375 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:45.375 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:45.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:45.444 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:45.443+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:45.490 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:45.490 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:45.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:45.490 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:45.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.782428918999997, 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:45.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:45.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.781819749999997, 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.926207391000005, 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.720414319, 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:45.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:45.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.719731324999998, 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:45.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:45.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:45.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.520 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.719684432999998, 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:45.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.719644713999998, 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:45.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:45.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:45.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:45.533 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.719590392999997, 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:45.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:45.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:45.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.719529725999998, 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:45.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:45.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:45.546 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.719403821, 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.552 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.719375638000002, 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:45.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.707344912000003, 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:45.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.707298885, 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:45.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:45.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.707265266, 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:45.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:45.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.707218507, 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.572 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:45.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:45.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:45.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:45.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:45.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:45.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:45.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.706998431999999, 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.579 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.706875054999998, 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:45.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.706698736999996, 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.589 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:45.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.705004610000003, 2023-11-19T00:39:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:45.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:45.599 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.703952837999999, 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:45.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:45.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:45.608 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:45.609 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:45.610 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:45.608+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:45.710 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:45.709+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:45.726 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:45.726 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:45.729 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:39:45.735 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:45.820 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:45.819+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:45.881 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:45.881 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:45.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:45.891 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:45.913 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:45.911+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:46.013 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:46.013+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:46.039 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.407715167999996, 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.040 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:46.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:46.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:46.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:46.047 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.882016390999993, 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:46.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:46.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:46.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:46.053 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.881902574999998, 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.054 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:46.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:46.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:46.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.881877184999993, 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.060 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:46.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:46.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.066 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.481101457999998, 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:46.067 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:46.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:46.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.073 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.270298115000003, 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:46.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:46.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.269807397000001, 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:46.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:46.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.269754773999999, 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:46.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:46.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:46.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:46.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:46.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.268278324999997, 2023-11-19T00:39:46.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:46.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:46.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:46.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.268234065999998, 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:46.103 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:46.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:46.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:46.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.110 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.268191662, 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:46.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:46.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:46.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:46.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.268144821, 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.118 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:46.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:46.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:46.124 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.268073573999999, 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:46.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:46.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:46.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.267877138000003, 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:46.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:46.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.267825387000002, 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.267619938000003, 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.267569002000002, 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.153 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:46.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:46.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.267130620000003, 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.160 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:46.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:46.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.267093492000001, 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.167 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:46.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:46.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.267032708000002, 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:46.174 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:46.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:46.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:46.179 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:46.180 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:46.181 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:46.181 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:46.180+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:46.181 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:46.182 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:46.182 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:46.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:46.183 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:46.282 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:46.281+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:46.300 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:46.302 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:46.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:46.383 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:46.382+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:46.415 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:46.415 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:46.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:46.484 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:46.483+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:46.528 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:46.528 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:46.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:46.585 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:46.584+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:46.653 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:46.653 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:46.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:46.686 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:46.685+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:46.767 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:46.768 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:46.776 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:46.786 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:46.786+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:46.880 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:46.881 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:46.887 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:46.886+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:46.889 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:46.988 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:46.987+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:47.003 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.003 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.012 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:47.089 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:47.088+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:47.117 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.118 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.126 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:47.189 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:47.189+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:47.270 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.271 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.279 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:47.323 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:47.322+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:47.387 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.387 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.391 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:47.390+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:47.395 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:47.492 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:47.492+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:47.541 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.541 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:47.594 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:47.593+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:47.694 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:47.694+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:47.696 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.696 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:47.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:39:47.795 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:47.794+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:47.896 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:47.896+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:47.975 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:47.975 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:47.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:47.998 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:47.998+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:48.088 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:48.088 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:48.097 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:48.098 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:48.098+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:48.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:48.200 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:48.199+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:48.207 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:48.207 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:48.216 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:48.300 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:48.300+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:48.332 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:48.361 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:48.361 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:48.366 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:48.366 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:48.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:48.397 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:48.398 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:48.411 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:48.411+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:48.502 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:48.502+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:48.517 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:48.517 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:48.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:48.517 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 73.885477197, 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:48.518 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:48.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:48.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:48.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.359778419999998, 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:48.526 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:48.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:48.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:48.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.533 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.359664604000002, 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.534 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:48.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:48.541 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.359639213999998, 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:48.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:48.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.958863487000002, 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:48.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:48.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:48.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:48.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.748060144, 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:48.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:48.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:48.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:48.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:48.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:48.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.747569425999998, 2023-11-19T00:39:48.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:48.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:48.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.747516803000003, 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.746040354000002, 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745996095000002, 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745953690999997, 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745906849999997, 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745835603000003, 2023-11-19T00:39:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745639167, 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745587415999999, 2023-11-19T00:39:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745381967, 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.745331030999999, 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.744892649000001, 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.744855520999998, 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.744794736999999, 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:48.678 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:48.680 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:48.679+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:48.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:48.736 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:39:48.779 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:48.779+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:48.798 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:48.798 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:48.798 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:48.798 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:48.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:48.881 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:48.880+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:48.952 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:48.952 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:48.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:48.981 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:48.981+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:49.068 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:49.068 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:49.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.296589557999994, 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.069 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:49.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:49.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295596791999998, 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:49.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:49.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:49.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:49.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:49.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:49.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:49.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:49.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:49.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:49.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:49.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.082 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295536403, 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:49.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:49.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:49.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295484279999997, 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:49.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:49.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:49.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.096 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295438602000004, 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:49.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:49.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295411677000004, 2023-11-19T00:39:49.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:49.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.109 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295383706999999, 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:49.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295356909000006, 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:49.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295326160000002, 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:49.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:49.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:49.125 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.295304904000005, 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:49.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:49.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.289247111999998, 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:49.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.289197396000006, 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:49.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:49.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:49.139 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.288682707999996, 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:49.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.288320970000001, 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:49.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:49.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.288032032999993, 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.149 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:49.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:49.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:49.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.156 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.285597698000004, 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:49.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:49.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.161 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.285569152999997, 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:49.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:49.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 59.217957591000001, 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:49.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:49.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:49.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:49.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.175 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 39.217473617000003, 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:49.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:49.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:49.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:49.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:49.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:49.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:49.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:49.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:49.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.217317700000002, 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.189 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.190 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.190 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:49.190 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:49.190 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:49.191 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:49.192 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:49.191+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:49.292 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:49.292+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:49.307 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:49.308 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:49.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:49.393 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:49.393+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:49.464 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:49.465 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:49.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:49.494 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:49.494+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:49.577 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.578 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.869829366999994, 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:49.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.869220197999994, 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:49.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.013607839000002, 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:49.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.597 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.807814766999996, 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:49.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.807131772999995, 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:49.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.807084880999994, 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:49.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:49.617 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.807045161999994, 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.618 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:49.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:49.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.806990841000001, 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:49.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:49.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:49.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.806930174000001, 2023-11-19T00:39:49.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:49.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:49.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:49.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:49.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.806804268999997, 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:49.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:49.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:49.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:49.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.806776085999999, 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.794745359999993, 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:49.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.657 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.794699332999997, 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:49.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:49.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.794665714000004, 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.663 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.794618955000004, 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.794398880000003, 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:49.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:49.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.794275502999994, 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:49.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.794099184999993, 2023-11-19T00:39:49.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:49.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:49.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:49.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:49.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.792405058, 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.691 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:49.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:49.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.791353286000003, 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:49.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:49.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:49.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:49.702 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:49.704 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:49.704 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:49.703+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:49.805 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:49.804+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:49.820 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:49.821 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:49.830 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:49.906 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:49.905+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:49.936 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:49.936 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:49.936 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:49.936 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:49.936 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:49.945 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:50.006 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:50.005+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:50.092 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:50.092 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:50.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:50.092 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 75.460239955999995, 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:50.093 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:50.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:50.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:50.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.101 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 73.934541179000007, 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:50.102 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:50.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 73.934427362999998, 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:50.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:50.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:50.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:50.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 73.934401973000007, 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.116 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:50.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:50.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:50.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 73.533626245999997, 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.123 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:50.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.322822903000002, 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:50.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:50.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:50.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:50.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.322332184999993, 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.137 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:50.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:50.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.144 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.322279562000006, 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:50.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:50.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:50.152 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320803112999997, 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:50.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320758854000005, 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:50.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:50.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:50.167 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320716450000006, 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:50.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:50.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:50.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:50.174 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320669609000007, 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:50.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:50.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320598361999998, 2023-11-19T00:39:50.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:50.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:50.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:50.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:50.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320401926000002, 2023-11-19T00:39:50.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:50.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:50.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320350175000002, 2023-11-19T00:39:50.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:50.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320144725999995, 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:50.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:50.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.209 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.320093790000001, 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:50.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:50.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.216 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.319655408000003, 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:50.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:50.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:50.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.31961828, 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:50.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:50.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:50.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.231 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.319557496000002, 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:50.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:50.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:50.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:50.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:50.237 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.237 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.237 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.237 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:50.237 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:50.237 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:50.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:50.239 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:50.237+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:50.264 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:50.265 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:50.265 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-11-19T00:39:50.265 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:39:50.265 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:39:50.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-11-19T00:39:50.339 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:50.338+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:50.358 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:50.358 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:50.359 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:50.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:50.395 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:50.395 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "" 2023-11-19T00:39:50.395 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:50.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:50.440 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:50.440+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:50.500 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:50.501 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:50.501 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:50.501 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:50.501 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:50.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:50.541 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:50.541+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:50.564 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:50.564 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:50.598 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:50.598 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:50.614 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:50.614 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:50.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:50.630 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:50.641 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:50.641+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:50.739 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:50.739 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:50.742 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:50.742+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:50.748 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:50.755 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:39:50.843 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:50.843+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:50.854 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:50.854 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:50.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:50.944 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:50.943+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:50.969 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:50.969 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:50.977 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:51.044 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:51.044+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:51.092 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.092 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.100 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:51.145 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:51.145+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:51.246 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.246 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.247 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:51.246+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:51.255 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:51.347 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:51.347+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:51.359 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.359 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:51.448 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:51.448+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:51.485 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.486 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:51.550 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:51.550+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:51.599 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.599 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:51.650 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:51.650+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:51.714 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.714 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.723 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:39:51.750 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:51.750+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:51.835 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.835 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:51.888 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:51.887+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:51.950 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:51.950 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:51.952 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:51.952+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:51.958 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:52.053 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:52.052+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:52.105 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:52.105 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:52.113 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:52.158 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:52.157+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:52.238 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:52.255 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:52.255+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:52.356 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:52.356+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:52.384 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:52.384 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:52.393 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:52.458 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:52.457+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:52.497 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:52.497 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:52.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:52.559 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:52.559+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:52.621 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:52.621 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:52.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:52.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:52.673 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:52.673+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:52.735 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:52.735 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:52.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:52.761 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:52.760+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:52.780 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:52.780 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:52.799 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:52.800 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:52.825 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:52.826 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:52.862 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:52.861+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:52.891 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:52.891 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:52.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:52.891 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:52.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.891 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.119434370999997, 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:52.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118441605000001, 2023-11-19T00:39:52.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:52.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:52.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118381216000003, 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.901 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:52.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:52.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.906 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118329093, 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:52.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:52.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118283414999993, 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:52.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:52.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:52.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118256489999993, 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:52.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:52.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.924 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118228520000002, 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:52.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:52.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:52.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118201721999995, 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:52.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:52.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118170973000005, 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:52.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:52.939 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.118149716999994, 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:52.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.112091925000001, 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:52.944 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:52.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:52.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.112042208999995, 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:52.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.111527520999999, 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.953 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:52.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.957 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.111165783000004, 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:52.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:52.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.110876845999996, 2023-11-19T00:39:52.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:52.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.108442511000007, 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.108413966000001, 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.040802403999997, 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 43.040318429999999, 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:52.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.989 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.040162512999999, 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:52.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:52.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:52.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:52.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.996 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:52.996 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:52.996 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:52.997 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:52.998 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:52.996+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:53.098 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:53.097+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:53.112 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:53.112 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:53.112 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:53.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:53.199 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:53.198+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:53.265 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:53.266 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:53.275 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:53.301 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:53.300+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:53.382 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.673901624999999, 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.673292455999999, 2023-11-19T00:39:53.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:53.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.817680096999993, 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:53.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.611887025000001, 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.397 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:53.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.611204031, 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.611157138999999, 2023-11-19T00:39:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.611117419999999, 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.611063099000006, 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.611002432000006, 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.610876527000002, 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.610848344000004, 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.598817617999998, 2023-11-19T00:39:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:53.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:53.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:53.524 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.598771591000002, 2023-11-19T00:39:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:53.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:53.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:53.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.598737971999995, 2023-11-19T00:39:53.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:53.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:53.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.598691212999995, 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:53.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.598471137999994, 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:53.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.598347760999999, 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.598171442999998, 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:53.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:53.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.596477316000005, 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:53.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:53.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.595425543999994, 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:53.562 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:53.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:53.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:53.567 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:53.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:53.569 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:53.568+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:53.669 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:53.669+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:53.684 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:53.684 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:53.693 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:53.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:39:53.770 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:53.769+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:53.799 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:53.799 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:53.800 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:53.800 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:53.800 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:53.808 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:53.871 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:53.871+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:53.955 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:53.955 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:53.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:53.955 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 79.323052019000002, 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:53.956 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:53.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:53.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:53.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:53.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:53.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:53.963 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.963 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:53.963 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.797353242, 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:53.964 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:53.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.797239426000004, 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:53.971 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:53.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:53.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.797214036, 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.978 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.396438309000004, 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.185634965999995, 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.185144248, 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:54.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:54.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:54.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.185091624999998, 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.006 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:54.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.183615176000004, 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.183570916999997, 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.183528512999999, 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.183481671999999, 2023-11-19T00:39:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:54.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.037 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:54.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.041 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.183410425000005, 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:54.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.183213988999995, 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:54.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:54.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.183162237999994, 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:54.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:54.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.182956789000002, 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:54.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:54.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.182905852999994, 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:54.070 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:54.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:54.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:54.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.182467470999995, 2023-11-19T00:39:54.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:54.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:54.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:54.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:54.084 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.182430342999993, 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:54.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:54.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:54.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:54.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.091 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.182369558999994, 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:54.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:54.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.096 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:54.097 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:54.097 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:54.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:54.099 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:54.097+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:54.199 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:54.199+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:54.215 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:54.215 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:54.215 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:54.215 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:54.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:54.300 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:54.299+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:54.332 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:54.332 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:54.332 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:54.332 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:54.332 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:54.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:54.401 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:54.401+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:54.487 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:54.487 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:54.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:54.487 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:54.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.715454464000004, 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014759930000000001, 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770167+0000", 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1600000000000001e-07 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770178+0000", 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0995999999999999e-05 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770198+0000", 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9409e-05 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770220+0000", 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2677e-05 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.770314+0000", 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3581999999999999e-05 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771643+0000", 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292130000000001 2023-11-19T00:39:54.491 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714461697999994, 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:54.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:54.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.498 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714401308999996, 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:54.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:54.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:54.504 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714349186000007, 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714303508, 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:54.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.517 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714276583, 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:54.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:54.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.523 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714248612999995, 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:54.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:54.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:54.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714221815000002, 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:54.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:54.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:54.535 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714191065999998, 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:54.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.714169810000001, 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:54.540 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:54.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:54.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:54.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.708112017999994, 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000216768, 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:54.545 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777509+0000", 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9100000000000004e-07 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777514+0000", 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5460000000000002e-06 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777523+0000", 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3799999999999994e-06 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777538+0000", 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5034999999999999e-05 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777594+0000", 2023-11-19T00:39:54.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5726999999999997e-05 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777602+0000", 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0299999999999994e-06 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777726+0000", 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000124559 2023-11-19T00:39:54.549 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.708062302000002, 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00031492800000000002, 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:54.550 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777559+0000", 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2500000000000001e-07 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777563+0000", 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4699999999999998e-06 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777579+0000", 2023-11-19T00:39:54.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5670000000000001e-05 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777585+0000", 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777754+0000", 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168729 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777760+0000", 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3999999999999997e-06 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777874+0000", 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391999999999999 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.554 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.707547614000006, 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:54.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:54.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.707185875999997, 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021807, 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778436+0000", 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0400000000000002e-07 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778439+0000", 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4920000000000002e-06 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778447+0000", 2023-11-19T00:39:54.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778454+0000", 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7410000000000003e-06 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778499+0000", 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5819999999999998e-05 2023-11-19T00:39:54.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778507+0000", 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.79e-06 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778654+0000", 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000146525 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.706896939000003, 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:54.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:54.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.704462604, 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00065569100000000002, 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.570 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781159+0000", 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1199999999999998e-07 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781169+0000", 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0190000000000001e-05 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781175+0000", 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6910000000000002e-06 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781179+0000", 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3510000000000002e-06 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781222+0000", 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3625000000000003e-05 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781244+0000", 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2192e-05 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781783+0000", 2023-11-19T00:39:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053883999999999996 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781815+0000", 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1390000000000003e-05 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:54.575 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 69.704434058999993, 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000904519, 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781187+0000", 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781188+0000", 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2700000000000001e-07 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781190+0000", 2023-11-19T00:39:54.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5809999999999999e-06 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781195+0000", 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7480000000000001e-06 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6220000000000001e-06 2023-11-19T00:39:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781417+0000", 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000219144 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781431+0000", 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.43e-05 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782072+0000", 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064132600000000001 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.782092+0000", 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9570999999999999e-05 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.636822496999997, 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:54.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 44.636338522999999, 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:54.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:54.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 39.636182605999998, 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:54.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:54.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:54.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:54.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:54.602 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:54.602 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:54.601+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:54.703 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:54.702+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:54.717 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:54.718 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:54.726 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:39:54.803 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:54.803+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:54.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:54.874 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:54.874 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:54.883 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:54.926 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:54.926+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:54.975 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:54.975 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:54.989 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.282027818000003, 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 79.281418649000003, 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.425806289999997, 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.220013218000005, 2023-11-19T00:39:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.219330224000004, 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.219283332000003, 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.219243613000003, 2023-11-19T00:39:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.219189291999996, 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.219128624999996, 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.219002720000006, 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.218974536999994, 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.206943811000002, 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.206897784000006, 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.206864164999999, 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.206817405999999, 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:55.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.206597330999998, 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.206473954000003, 2023-11-19T00:39:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.206297636000002, 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.204603508999995, 2023-11-19T00:39:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 70.203551736999998, 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:55.098 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:55.099 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:55.100 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:55.098+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:55.100 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:55.100 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:55.101 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:55.102 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:55.200 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:55.199+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:55.217 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:55.217 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:55.227 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:55.301 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:55.301+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:55.332 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:55.340 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:55.403 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:55.402+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:55.407 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:39:55.407 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:39:55.408 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-11-19T00:39:55.408 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:39:55.408 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:39:55.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-11-19T00:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:55.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:55.504 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:55.503+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "" 2023-11-19T00:39:55.514 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:55.561 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:55.561 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:55.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:55.605 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:55.604+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:55.675 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:55.675 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:55.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:55.706 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:55.706+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:55.788 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:55.788 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:55.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:55.841 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:55.840+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:55.902 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:55.902 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:55.909 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:55.908+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:55.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:56.010 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:56.009+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:56.057 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.057 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.065 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:56.112 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:56.110+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:56.171 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.171 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.179 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:56.220 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:56.219+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:56.285 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.285 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:56.314 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:56.313+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:56.438 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'. 2023-11-19T00:39:56.438 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:39:56.438 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-19T00:39:56.438 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-19T00:39:56.438 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2023-11-19T00:39:56.438 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:39:56.438 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:39:56.439 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at b0f45a51a24 Merge pull request #54530 from yuw1/fix_typo 2023-11-19T00:39:56.443 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-19T00:39:56.451 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:56.451+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:56.471 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-19T00:39:56.474 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-19T00:39:56.474 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-19T00:39:56.513 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.513 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.515 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:56.514+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:56.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:56.616 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:56.615+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:56.635 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.635 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:56.717 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:56.717+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:56.748 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.749 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:56.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:39:56.818 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:56.817+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:56.862 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.862 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:56.919 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:56.919+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:56.976 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:56.976 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:56.984 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:57.020 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:57.020+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:57.088 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:57.088 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:57.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:57.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:39:57.121 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:57.121+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:57.202 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:57.212 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:57.241 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-19T00:39:57.251 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:57.252 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:57.255 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:57.255+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:57.270 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:57.270 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:57.297 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-19T00:39:57.321 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:57.321 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:57.321 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:57.321 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:57.322 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:57.322+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:57.330 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:57.338 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-19T00:39:57.340 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-19T00:39:57.340 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-19T00:39:57.380 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-19T00:39:57.383 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:39:57.385 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-19T00:39:57.423 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:57.423+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:57.440 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2023-11-19T00:39:57.441 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2023-11-19T00:39:57.441 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2023-11-19T00:39:57.474 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:57.474 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:57.475 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:57.475 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:57.475 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:57.483 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:57.502 INFO:tasks.workunit.client.0.smithi046.stderr:+ set -e 2023-11-19T00:39:57.502 INFO:tasks.workunit.client.0.smithi046.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2023-11-19T00:39:57.504 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into 'xfstests-dev'... 2023-11-19T00:39:57.525 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:57.524+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:57.625 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:57.625+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:57.631 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:57.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.999432131000006, 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:57.632 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:57.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:57.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:57.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.639 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.473733354000004, 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:57.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:57.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.473619537999994, 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:57.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:57.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.473594148000004, 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:57.653 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:57.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:57.659 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.072818420999994, 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:57.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:57.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.862015077999999, 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:57.666 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:57.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:57.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.861524360000004, 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:57.673 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:57.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.861471737000002, 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859995287999993, 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859951029000001, 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859908625000003, 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859861784000003, 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859790536999995, 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859594100999999, 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859542349999998, 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859336901000006, 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.859285964999998, 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.858847582999999, 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.858810454999997, 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 72.858749670999998, 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:57.773 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:39:57.775 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:57.774+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:57.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:57.875 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:57.875+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:57.887 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:57.887 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:57.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:57.979 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:57.979+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:58.040 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:58.040 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:58.040 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:39:58.040 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:39:58.040 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:58.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:58.089 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:58.089+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:58.177 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:58.177+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:58.197 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.424236441999994, 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:39:58.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:58.205 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.424176052999997, 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:39:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:39:58.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.424123929999993, 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.212 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:39:58.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.424078252000001, 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:39:58.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.225 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.424051327000001, 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:39:58.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:39:58.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.424023356999996, 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.232 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:39:58.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:39:58.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:39:58.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:39:58.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.423996559000003, 2023-11-19T00:39:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:39:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.423965809999999, 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:39:58.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:39:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.248 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.423944554000002, 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:39:58.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.417322358000007, 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:39:58.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.258 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.416671683000004, 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017724570000000001, 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778725+0000", 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4600000000000004e-07 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778731+0000", 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0589999999999999e-06 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778751+0000", 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9587999999999999e-05 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778758+0000", 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3969999999999997e-06 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778833+0000", 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4719000000000001e-05 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778854+0000", 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1455e-05 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780455+0000", 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016009119999999999 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780497+0000", 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1681000000000003e-05 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.346597240999998, 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001662462, 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848799+0000", 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848800+0000", 2023-11-19T00:39:58.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.218e-06 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848806+0000", 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0979999999999999e-06 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848820+0000", 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3803e-05 2023-11-19T00:39:58.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848829+0000", 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8550000000000008e-06 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.848933+0000", 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000104522 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849038+0000", 2023-11-19T00:39:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010463000000000001 2023-11-19T00:39:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849148+0000", 2023-11-19T00:39:58.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011029 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.849849+0000", 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070089399999999997 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850399+0000", 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054996500000000002 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850436+0000", 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6829000000000003e-05 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:49.850461+0000", 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5358e-05 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.271 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 48.346113267, 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:39:58.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:39:58.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:39:58.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:39:58.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 43.345957349999999, 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:39:58.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:39:58.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:39:58.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:39:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4570.0:12 4.28 e38/17 4:15246602:::10000000202.00000000:head v 38'2, mlcod=0'0)", 2023-11-19T00:39:58.286 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.523943+0000", 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.67145333200000001, 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022959769999999998, 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523943+0000", 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523943+0000", 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523944+0000", 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8100000000000002e-07 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523948+0000", 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5950000000000001e-06 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523958+0000", 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0087e-05 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523981+0000", 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235e-05 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.524017+0000", 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5345999999999997e-05 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.524034+0000", 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6674e-05 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.526193+0000", 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021594890000000001 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.526239+0000", 2023-11-19T00:39:58.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.587e-05 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4570.0:13 4.2b e38/17 4:d4a58307:::10000000203.00000000:head v 38'1, mlcod=0'0)", 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.525394+0000", 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.67000246399999996, 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003652115, 2023-11-19T00:39:58.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525394+0000", 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525394+0000", 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525395+0000", 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6470000000000001e-06 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525407+0000", 2023-11-19T00:39:58.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1712999999999999e-05 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525432+0000", 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5222999999999999e-05 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525444+0000", 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1929999999999999e-05 2023-11-19T00:39:58.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525550+0000", 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010572400000000001 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525578+0000", 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8323e-05 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529018+0000", 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034392730000000001 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529046+0000", 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8282000000000001e-05 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:16 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~900] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.527946+0000", 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.66744980099999995, 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065247450000000002, 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:39:58.298 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 16 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527946+0000", 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527946+0000", 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527948+0000", 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9870000000000002e-06 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527958+0000", 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7829999999999993e-06 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527987+0000", 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8462999999999998e-05 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528000+0000", 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3346000000000001e-05 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528139+0000", 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000139297 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528316+0000", 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017640000000000001 2023-11-19T00:39:58.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528384+0000", 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8793000000000004e-05 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.531696+0000", 2023-11-19T00:39:58.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033111669999999998 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534317+0000", 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026211720000000002 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534433+0000", 2023-11-19T00:39:58.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000116564 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534471+0000", 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7772999999999999e-05 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.305 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:17 4.7 4:e15a914f:::10000000207.00000000:head [write 0~428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.528960+0000", 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.66643583799999995, 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0056926820000000001, 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 17 2023-11-19T00:39:58.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528960+0000", 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528960+0000", 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528961+0000", 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3099999999999996e-07 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528967+0000", 2023-11-19T00:39:58.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.592e-06 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528978+0000", 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0647e-05 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528988+0000", 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0771000000000001e-05 2023-11-19T00:39:58.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529058+0000", 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9649999999999999e-05 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529166+0000", 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000108414 2023-11-19T00:39:58.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529292+0000", 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125551 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.530210+0000", 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00091756499999999996 2023-11-19T00:39:58.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534600+0000", 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043907979999999996 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534632+0000", 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1684999999999999e-05 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534653+0000", 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1078e-05 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4570.0:20 4.14 e38/17 4:29971f97:::1000000020e.00000000:head v 38'1, mlcod=0'0)", 2023-11-19T00:39:58.313 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.538821+0000", 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.65657514699999997, 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001667782, 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538821+0000", 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538821+0000", 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538830+0000", 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9830000000000002e-06 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538840+0000", 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0424e-05 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538859+0000", 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8851999999999998e-05 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538871+0000", 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-05 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538942+0000", 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1159000000000001e-05 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.538954+0000", 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2249000000000001e-05 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.540457+0000", 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015032629999999999 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.540489+0000", 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1642e-05 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:25 4.2d 4:b79a54f6:::10000000218.00000000:head [write 0~155] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.642353+0000", 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.55304345700000002, 2023-11-19T00:39:58.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037092499999999999, 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 25 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642353+0000", 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642353+0000", 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642354+0000", 2023-11-19T00:39:58.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642359+0000", 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.147e-06 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642371+0000", 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2561000000000001e-05 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642395+0000", 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3921e-05 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642452+0000", 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6949e-05 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:39:58.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642568+0000", 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115868 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642697+0000", 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012906899999999999 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.643794+0000", 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010968810000000001 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.646011+0000", 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022171589999999998 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:39:58.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.646040+0000", 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8992999999999998e-05 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.646062+0000", 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1722999999999999e-05 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:39:58.326 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:58.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:58.329 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:58.327+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:58.428 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:58.428+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:58.434 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:58.434 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:58.434 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:39:58.434 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:58.442 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:58.529 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:58.529+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:58.547 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:58.547 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:39:58.547 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:39:58.547 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:39:58.548 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:58.557 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:39:58.630 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:58.630+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:58.662 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:39:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:39:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.954453166999997, 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:39:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.953843997999996, 2023-11-19T00:39:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00501799, 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706985+0000", 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706986+0000", 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706991+0000", 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9270000000000002e-06 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707008+0000", 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6818999999999999e-05 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707013+0000", 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0499999999999999e-06 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707052+0000", 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8315000000000002e-05 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.707064+0000", 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2401999999999999e-05 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711978+0000", 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049142029999999998 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.712003+0000", 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4681999999999998e-05 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.098231639000005, 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:39:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:39:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.892438566999999, 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:39:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:39:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.891755572999998, 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:39:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:39:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:39:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.891708680999997, 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:39:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:39:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:39:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.891668961999997, 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:39:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.891614641000004, 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:39:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:39:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.891553974000004, 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:39:58.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:39:58.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:39:58.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:39:58.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.891428069, 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:39:58.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:39:58.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.891399886000002, 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:58.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:39:58.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:58.732 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.879369159999996, 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:39:58.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.737 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.879323133, 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:39:58.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.879289514000007, 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:39:58.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:39:58.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.747 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.879242755000007, 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:39:58.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:39:58.752 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.879022680000006, 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:39:58.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:58.757 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.878899302999997, 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:39:58.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.878722984999996, 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051413750000000001, 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:58.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782106+0000", 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.23e-07 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782110+0000", 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782118+0000", 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0219999999999999e-06 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782125+0000", 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2880000000000004e-06 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782163+0000", 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8683999999999998e-05 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782182+0000", 2023-11-19T00:39:58.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8513e-05 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787213+0000", 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050310399999999996 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787247+0000", 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4269e-05 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.767 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.877028858000003, 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:39:58.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=0'0)", 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.875977086000006, 2023-11-19T00:39:58.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051768589999999998, 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784852+0000", 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784853+0000", 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.78e-07 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:39:58.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784858+0000", 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7100000000000004e-06 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784871+0000", 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2391e-05 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784877+0000", 2023-11-19T00:39:58.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2929999999999997e-06 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784919+0000", 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2230000000000001e-05 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.784932+0000", 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2595999999999999e-05 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790006+0000", 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005074378 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790029+0000", 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2382999999999999e-05 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.778 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.779 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.779 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:39:58.779 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:39:58.779 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:39:58.780 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:39:58.781 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:39:58.779+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:39:58.881 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:58.880+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:58.898 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:58.898 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:58.898 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:39:58.898 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:58.907 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:39:58.981 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:58.980+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:59.013 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:59.013 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:39:59.013 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:39:59.014 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:39:59.014 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:59.022 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:39:59.106 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:59.105+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 84.538690915999993, 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.171 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:39:59.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:39:59.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 83.012992139000005, 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:39:59.179 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 83.012878322999995, 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:59.186 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:39:59.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:39:59.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 83.012852933000005, 2023-11-19T00:39:59.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:39:59.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:39:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:59.199 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.612077205999995, 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:39:59.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:39:59.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:39:59.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.401273863, 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:39:59.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:39:59.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:39:59.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.400783145000005, 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:59.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:39:59.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:39:59.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.400730522000003, 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:39:59.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:39:59.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:39:59.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:39:59.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:39:59.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.399254072999994, 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:39:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:39:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.399209814000002, 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:39:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.399167410000004, 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:39:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:39:59.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.399120569000004, 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:39:59.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:39:59.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:39:59.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.399049321999996, 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:39:59.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:39:59.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.262 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.398852886, 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:39:59.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:39:59.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:39:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.398801134999999, 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.398595685999993, 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.398544749999999, 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.398106368000001, 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.291 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:39:59.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:39:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.398069239999998, 2023-11-19T00:39:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:59.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:39:59.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:39:59.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:39:59.305 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.398008455999999, 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:39:59.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:39:59.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.311 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:39:59.311 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:39:59.311 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:39:59.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:39:59.313 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:59.311+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:59.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:39:59.413 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:59.412+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:59.429 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:39:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:39:59.430 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:39:59.430 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:39:59.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:39:59.458 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:39:59.458 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:39:59.478 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:39:59.478 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:39:59.497 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:39:59.497 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:39:59.513 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:59.512+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:59.586 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:59.586 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:59.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:39:59.614 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:39:59.613+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:39:59.700 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:59.700 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:59.709 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:39:59.715 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:59.714+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:59.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:39:59.816 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:59.816+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:59.832 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:59.832 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:59.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:39:59.918 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:39:59.917+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:39:59.948 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:39:59.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:00.018 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:00.018+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:00.065 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:00.066 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:00.075 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:00.119 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:00.119+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:00.195 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:00.195 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:00.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:00.249 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:00.248+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:00.321 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:00.321+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:00.327 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:00.327 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:00.337 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:00.422 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:00.420+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:00.488 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:00.488 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:00.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:00.523 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:40:00.523 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:40:00.523 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-11-19T00:40:00.524 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.866225 2023-11-19T00:40:00.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.8662254202446409 2023-11-19T00:40:00.538 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:00.537+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:00.623 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:00.623 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:00.623 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:00.621+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:00.632 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:00.724 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:00.722+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:00.749 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:00.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:00.769 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:40:00.824 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:00.823+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:00.870 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:00.871 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:00.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:00.925 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:00.924+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:01.000 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:01.000 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:01.010 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:01.026 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:01.025+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:01.124 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:01.124 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:01.126 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:01.126+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:01.134 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:01.227 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:01.227+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:01.287 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:01.288 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:01.297 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:01.341 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:01.340+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:01.409 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:01.409 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:01.418 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:01.429 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:01.428+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:01.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:01.529 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:01.529+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:01.571 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:01.572 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:01.581 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:01.630 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:01.629+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:01.653 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:01.675 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:01.696 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:01.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:01.731 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:01.730+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:01.774 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.2 primary-affinity to 0.866225 (8567682) 2023-11-19T00:40:01.813 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4.7ed6ca35 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.033879660999999998, 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.033895446000000003, 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:01.814 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:01.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4.4e2b5535 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.0081071489999999993, 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081608679999999999, 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4.51193e35 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.029292994999999999, 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.029379019999999999, 2023-11-19T00:40:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-19T00:40:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 3 2023-11-19T00:40:01.828 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:01.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:01.832 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:01.830+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:01.933 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:01.932+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:01.941 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:01.941 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:01.941 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:01.941 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:01.941 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:01.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:02.033 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:02.032+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:02.107 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.334074138000005, 2023-11-19T00:40:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065517170000000003, 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771160+0000", 2023-11-19T00:40:02.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771162+0000", 2023-11-19T00:40:02.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.793e-06 2023-11-19T00:40:02.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771172+0000", 2023-11-19T00:40:02.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0268999999999999e-05 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771184+0000", 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1807000000000001e-05 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771192+0000", 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5629999999999992e-06 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1063000000000006e-05 2023-11-19T00:40:02.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771407+0000", 2023-11-19T00:40:02.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013361699999999999 2023-11-19T00:40:02.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771567+0000", 2023-11-19T00:40:02.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016057699999999999 2023-11-19T00:40:02.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775488+0000", 2023-11-19T00:40:02.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003920715 2023-11-19T00:40:02.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777607+0000", 2023-11-19T00:40:02.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021192910000000001 2023-11-19T00:40:02.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777659+0000", 2023-11-19T00:40:02.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1193999999999998e-05 2023-11-19T00:40:02.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777711+0000", 2023-11-19T00:40:02.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2828000000000003e-05 2023-11-19T00:40:02.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.118 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.119 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.119 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.334013748999993, 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066445610000000002, 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771220+0000", 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771221+0000", 2023-11-19T00:40:02.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.54e-07 2023-11-19T00:40:02.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771227+0000", 2023-11-19T00:40:02.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8969999999999996e-06 2023-11-19T00:40:02.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771237+0000", 2023-11-19T00:40:02.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8130000000000007e-06 2023-11-19T00:40:02.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771243+0000", 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6630000000000004e-06 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771849+0000", 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00060564099999999997 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771928+0000", 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8590999999999993e-05 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772094+0000", 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016679100000000001 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775492+0000", 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033971940000000001 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777766+0000", 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022744969999999999 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777829+0000", 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3002000000000004e-05 2023-11-19T00:40:02.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777865+0000", 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5717999999999999e-05 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:40:02.127 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.333961626000004, 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007374813, 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771272+0000", 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771273+0000", 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8700000000000005e-07 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771291+0000", 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7762e-05 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771300+0000", 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0010000000000007e-06 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771307+0000", 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1670000000000002e-06 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771844+0000", 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053732900000000002 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771959+0000", 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115186 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772072+0000", 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011251000000000001 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775840+0000", 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037683130000000001 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778513+0000", 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002672977 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778566+0000", 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3162999999999999e-05 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778647+0000", 2023-11-19T00:40:02.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0717999999999995e-05 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.333915947999998, 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097590300000000001, 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771318+0000", 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771319+0000", 2023-11-19T00:40:02.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6700000000000003e-07 2023-11-19T00:40:02.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771323+0000", 2023-11-19T00:40:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8330000000000004e-06 2023-11-19T00:40:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771330+0000", 2023-11-19T00:40:02.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6899999999999992e-06 2023-11-19T00:40:02.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771337+0000", 2023-11-19T00:40:02.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9450000000000004e-06 2023-11-19T00:40:02.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773130+0000", 2023-11-19T00:40:02.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001792515 2023-11-19T00:40:02.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773208+0000", 2023-11-19T00:40:02.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8684999999999996e-05 2023-11-19T00:40:02.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773358+0000", 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149875 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.776649+0000", 2023-11-19T00:40:02.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032907779999999998 2023-11-19T00:40:02.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781025+0000", 2023-11-19T00:40:02.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043757190000000001 2023-11-19T00:40:02.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781058+0000", 2023-11-19T00:40:02.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3498999999999999e-05 2023-11-19T00:40:02.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781077+0000", 2023-11-19T00:40:02.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8723999999999999e-05 2023-11-19T00:40:02.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.333889022999998, 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.009887112, 2023-11-19T00:40:02.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771345+0000", 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4000000000000002e-07 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771349+0000", 2023-11-19T00:40:02.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5030000000000002e-06 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771356+0000", 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.627e-06 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771365+0000", 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000005e-06 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773478+0000", 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021136140000000002 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773670+0000", 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019148400000000001 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.773813+0000", 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014286600000000001 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.777400+0000", 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035877209999999999 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781143+0000", 2023-11-19T00:40:02.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037425179999999998 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781198+0000", 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5528000000000001e-05 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781232+0000", 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3550999999999998e-05 2023-11-19T00:40:02.151 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.333861053000007, 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098620730000000007, 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771373+0000", 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.84e-07 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771376+0000", 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0939999999999999e-06 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771383+0000", 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5799999999999997e-06 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771388+0000", 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7999999999999998e-06 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771473+0000", 2023-11-19T00:40:02.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5624000000000006e-05 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771613+0000", 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014003799999999999 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771780+0000", 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016691500000000001 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774115+0000", 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023347870000000001 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781164+0000", 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070492669999999997 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781202+0000", 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7999e-05 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781235+0000", 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2585000000000001e-05 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.333834254999999, 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0099340780000000007, 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:40:02.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771400+0000", 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0999999999999999e-07 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771403+0000", 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.869e-06 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771410+0000", 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4610000000000002e-06 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771416+0000", 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.755e-06 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772193+0000", 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077721300000000001 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.772376+0000", 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018299200000000001 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.781334+0000", 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089573780000000002 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.163 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.333803505999995, 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013959133, 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771430+0000", 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771431+0000", 2023-11-19T00:40:02.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7100000000000002e-07 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771433+0000", 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2709999999999999e-06 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771440+0000", 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7479999999999996e-06 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771445+0000", 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.656e-06 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.774975+0000", 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00353069 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.775107+0000", 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013172800000000001 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.785390+0000", 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010282569 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.333782249999999, 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071703959999999999, 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.169 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:40:02.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771452+0000", 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9700000000000002e-07 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771455+0000", 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.542e-06 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771461+0000", 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.365e-06 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771469+0000", 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1920000000000005e-06 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771520+0000", 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0682e-05 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.771709+0000", 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018963000000000001 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778622+0000", 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069125879999999999 2023-11-19T00:40:02.173 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 77.327160054000004, 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021774849999999998, 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.174 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778074+0000", 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778075+0000", 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1600000000000001e-07 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778102+0000", 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7228000000000001e-05 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778112+0000", 2023-11-19T00:40:02.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8779999999999993e-06 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778127+0000", 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5608999999999999e-05 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6950000000000002e-05 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.778197+0000", 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3138e-05 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780228+0000", 2023-11-19T00:40:02.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020306439999999999 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:38:44.780251+0000", 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3322000000000001e-05 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-11-19T00:40:02.179 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.255950962999997, 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001811507, 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849283+0000", 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849286+0000", 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.807e-06 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849302+0000", 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5787e-05 2023-11-19T00:40:02.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849334+0000", 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2314999999999998e-05 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849350+0000", 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6586999999999999e-05 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849517+0000", 2023-11-19T00:40:02.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016649300000000001 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849645+0000", 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012798700000000001 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.849799+0000", 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015382899999999999 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.850497+0000", 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00069788300000000005 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851029+0000", 2023-11-19T00:40:02.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00053209000000000004 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851061+0000", 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2372000000000001e-05 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:09.851094+0000", 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3356999999999999e-05 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:40:02.188 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.255795046000003, 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001863518, 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849439+0000", 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849442+0000", 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.45e-06 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849458+0000", 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5566999999999999e-05 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849505+0000", 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6808000000000003e-05 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849513+0000", 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3829999999999992e-06 2023-11-19T00:40:02.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849590+0000", 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6536e-05 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849664+0000", 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3983e-05 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.849770+0000", 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106128 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.850536+0000", 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00076657099999999996 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851225+0000", 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000688391 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851261+0000", 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6556e-05 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:14.851302+0000", 2023-11-19T00:40:02.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1145e-05 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4570.0:12 4.28 e38/17 4:15246602:::10000000202.00000000:head v 38'2, mlcod=0'0)", 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.523943+0000", 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.5812910279999999, 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022959769999999998, 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.195 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523943+0000", 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523943+0000", 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523944+0000", 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8100000000000002e-07 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523948+0000", 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5950000000000001e-06 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523958+0000", 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0087e-05 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.523981+0000", 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235e-05 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.524017+0000", 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5345999999999997e-05 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.524034+0000", 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6674e-05 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.526193+0000", 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021594890000000001 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.526239+0000", 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.587e-05 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4570.0:13 4.2b e38/17 4:d4a58307:::10000000203.00000000:head v 38'1, mlcod=0'0)", 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.525394+0000", 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.5798401599999998, 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003652115, 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525394+0000", 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525394+0000", 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525395+0000", 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6470000000000001e-06 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525407+0000", 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1712999999999999e-05 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525432+0000", 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5222999999999999e-05 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525444+0000", 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1929999999999999e-05 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525550+0000", 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010572400000000001 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.525578+0000", 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8323e-05 2023-11-19T00:40:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529018+0000", 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034392730000000001 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529046+0000", 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8282000000000001e-05 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:16 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~900] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.527946+0000", 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.5772874970000004, 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065247450000000002, 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 16 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527946+0000", 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527946+0000", 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527948+0000", 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9870000000000002e-06 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527958+0000", 2023-11-19T00:40:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7829999999999993e-06 2023-11-19T00:40:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.527987+0000", 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8462999999999998e-05 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528000+0000", 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3346000000000001e-05 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528139+0000", 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000139297 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528316+0000", 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017640000000000001 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528384+0000", 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8793000000000004e-05 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.531696+0000", 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033111669999999998 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534317+0000", 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026211720000000002 2023-11-19T00:40:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534433+0000", 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000116564 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534471+0000", 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7772999999999999e-05 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:17 4.7 4:e15a914f:::10000000207.00000000:head [write 0~428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.528960+0000", 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.5762735340000003, 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0056926820000000001, 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 17 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528960+0000", 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528960+0000", 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528961+0000", 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3099999999999996e-07 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528967+0000", 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.592e-06 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528978+0000", 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0647e-05 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.528988+0000", 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0771000000000001e-05 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529058+0000", 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9649999999999999e-05 2023-11-19T00:40:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529166+0000", 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000108414 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.529292+0000", 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125551 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.530210+0000", 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00091756499999999996 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534600+0000", 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043907979999999996 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534632+0000", 2023-11-19T00:40:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1684999999999999e-05 2023-11-19T00:40:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.534653+0000", 2023-11-19T00:40:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1078e-05 2023-11-19T00:40:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:25 4.2d 4:b79a54f6:::10000000218.00000000:head [write 0~155] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:57.642353+0000", 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.4628811529999997, 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037092499999999999, 2023-11-19T00:40:02.221 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 25 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642353+0000", 2023-11-19T00:40:02.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642353+0000", 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642354+0000", 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642359+0000", 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.147e-06 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642371+0000", 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2561000000000001e-05 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642395+0000", 2023-11-19T00:40:02.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3921e-05 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642452+0000", 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6949e-05 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642568+0000", 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000115868 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.642697+0000", 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012906899999999999 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.643794+0000", 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010968810000000001 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.646011+0000", 2023-11-19T00:40:02.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022171589999999998 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.646040+0000", 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8992999999999998e-05 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:57.646062+0000", 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1722999999999999e-05 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.227 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4570.0:28 4.2e e39/17 4:74d13cfc:::1000000021c.00000000:head v 39'1, mlcod=0'0)", 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:39:59.055714+0000", 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.0495203879999999, 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010326254999999999, 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.055714+0000", 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.055714+0000", 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.055714+0000", 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2399999999999998e-07 2023-11-19T00:40:02.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.059625+0000", 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003911393 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.059642+0000", 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7042999999999999e-05 2023-11-19T00:40:02.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.059671+0000", 2023-11-19T00:40:02.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8138000000000001e-05 2023-11-19T00:40:02.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.059780+0000", 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010901200000000001 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.059804+0000", 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4610999999999999e-05 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.065969+0000", 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061649850000000004 2023-11-19T00:40:02.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:39:59.066040+0000", 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0549000000000005e-05 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4570.0:2306 4.1c e41/17 4:387e7c24:::10000000b21.00000000:head v 41'31, mlcod=41'29)", 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.057827+0000", 2023-11-19T00:40:02.233 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.047407268000000002, 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025055849999999998, 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057827+0000", 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057827+0000", 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057827+0000", 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6000000000000004e-07 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057834+0000", 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.331e-06 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057840+0000", 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6109999999999999e-06 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057844+0000", 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9979999999999997e-06 2023-11-19T00:40:02.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057878+0000", 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4045999999999999e-05 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.057891+0000", 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2706e-05 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.060298+0000", 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002407345 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.060332+0000", 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3988000000000001e-05 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.239 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2307 4.b 4:d02688e1:::10000000b22.00000000:head [write 0~3320] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.239 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.058353+0000", 2023-11-19T00:40:02.239 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.046881393, 2023-11-19T00:40:02.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022197110000000001, 2023-11-19T00:40:02.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:02.239 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.239 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2307 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058353+0000", 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058353+0000", 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058354+0000", 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1009999999999999e-06 2023-11-19T00:40:02.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058360+0000", 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0299999999999999e-06 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:02.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058372+0000", 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2468e-05 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058380+0000", 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3919999999999997e-06 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058422+0000", 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2862999999999999e-05 2023-11-19T00:40:02.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058496+0000", 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3639000000000004e-05 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.058576+0000", 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9853999999999998e-05 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.059363+0000", 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00078708300000000005 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:02.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.060492+0000", 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011289029999999999 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.060541+0000", 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8662999999999998e-05 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:02.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.060572+0000", 2023-11-19T00:40:02.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1714999999999997e-05 2023-11-19T00:40:02.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.247 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:02.247 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:02.247 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:02.249 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:02.247+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:02.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:02.349 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:02.348+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:02.364 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4.3040dd45 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.21365275, 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.21366668799999999, 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4.ef108a85 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.49506202799999999, 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.49511575400000002, 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4.140444c5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.55752580399999996, 2023-11-19T00:40:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.55761276999999998, 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4.87b57e05 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.394482679, 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.39460159500000003, 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4.d655a385 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.22917190000000001, 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.229324049, 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.388 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4.74678185 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.14786166000000001, 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.148055293, 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "waiting for peered", 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:02.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:02.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4570.0:2661 4.d e41/17 4:b03df500:::10000000c88.00000000:head v 41'39, mlcod=41'37)", 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.364384+0000", 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4294967295.9998512, 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2442999999999997e-05, 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.393 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364384+0000", 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364384+0000", 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364384+0000", 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8699999999999995e-07 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364388+0000", 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8809999999999998e-06 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364395+0000", 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4509999999999997e-06 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364399+0000", 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0999999999999997e-06 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364435+0000", 2023-11-19T00:40:02.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6695e-05 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.364447+0000", 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1742e-05 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 7 2023-11-19T00:40:02.397 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:02.399 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:02.450 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:02.449+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:02.551 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:02.549+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:02.558 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:02.558 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:02.558 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:02.558 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:02.559 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:02.568 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:02.651 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:02.650+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:02.683 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.975778304000002, 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056007260000000003, 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706376+0000", 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706377+0000", 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.009e-06 2023-11-19T00:40:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706428+0000", 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1511999999999997e-05 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706441+0000", 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2734999999999999e-05 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706449+0000", 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6149999999999999e-06 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706495+0000", 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6044000000000002e-05 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.706511+0000", 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6222000000000002e-05 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711937+0000", 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054257389999999997 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:35.711976+0000", 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.985e-05 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4164.0:189 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'139, mlcod=11'127)", 2023-11-19T00:40:02.688 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.119556775999996, 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0078292399999999995, 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562597+0000", 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562598+0000", 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9000000000000002e-07 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562601+0000", 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562607+0000", 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.404e-06 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.562611+0000", 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2849999999999999e-06 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563617+0000", 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010059369999999999 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.563630+0000", 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3188e-05 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570386+0000", 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0067564349999999999 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:36.570427+0000", 2023-11-19T00:40:02.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0278000000000003e-05 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.913763704000004, 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074424080000000002, 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768390+0000", 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768392+0000", 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8840000000000001e-06 2023-11-19T00:40:02.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768401+0000", 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2590000000000006e-06 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768415+0000", 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-05 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.768429+0000", 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4386000000000001e-05 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769057+0000", 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00062776100000000001 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769207+0000", 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015066499999999999 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017787200000000001 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771448+0000", 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020627050000000002 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775750+0000", 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043023100000000002 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775799+0000", 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8624000000000001e-05 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775833+0000", 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3742000000000003e-05 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.913080710000003, 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:40:02.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:40:02.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.913033818000002, 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:40:02.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:40:02.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.912994099000002, 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:02.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:40:02.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:40:02.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:40:02.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:40:02.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:40:02.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:40:02.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.717 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.912939777999995, 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061292940000000004, 2023-11-19T00:40:02.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769214+0000", 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769216+0000", 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4699999999999999e-06 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769222+0000", 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3690000000000003e-06 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769234+0000", 2023-11-19T00:40:02.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2129e-05 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769244+0000", 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9010000000000006e-06 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769372+0000", 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127675 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769605+0000", 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023322100000000001 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769879+0000", 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000274469 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771234+0000", 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013549009999999999 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775246+0000", 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040116400000000003 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775301+0000", 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5438e-05 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.775344+0000", 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2080999999999999e-05 2023-11-19T00:40:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.912879110999995, 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070850080000000003, 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769275+0000", 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769276+0000", 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.16e-07 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769280+0000", 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4649999999999996e-06 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769289+0000", 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5660000000000007e-06 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769385+0000", 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5851000000000001e-05 2023-11-19T00:40:02.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090992999999999998 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770372+0000", 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7506e-05 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770508+0000", 2023-11-19T00:40:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013565100000000001 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771775+0000", 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012676300000000001 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776253+0000", 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044778789999999997 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776318+0000", 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4778999999999998e-05 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.776360+0000", 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1934999999999997e-05 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.731 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.912753206000005, 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:40:02.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:40:02.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:40:02.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:40:02.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.912725022999993, 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:40:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.900694297000001, 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056770659999999997, 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781460+0000", 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8000000000000001e-07 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781471+0000", 2023-11-19T00:40:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0407999999999999e-05 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781484+0000", 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.329e-05 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781491+0000", 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.328e-06 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781532+0000", 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.066e-05 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781547+0000", 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5577999999999999e-05 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055306189999999996 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787137+0000", 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8802999999999999e-05 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.900648270000005, 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056340100000000001, 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781506+0000", 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781511+0000", 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3410000000000002e-06 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781520+0000", 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3960000000000006e-06 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781525+0000", 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6920000000000001e-06 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781563+0000", 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8498000000000003e-05 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781575+0000", 2023-11-19T00:40:02.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2274e-05 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787078+0000", 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055027180000000002 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787140+0000", 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1779000000000006e-05 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.900614650999998, 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056375000000000001, 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781539+0000", 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781540+0000", 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.41e-07 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781551+0000", 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0807e-05 2023-11-19T00:40:02.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781567+0000", 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6234000000000001e-05 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781573+0000", 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3770000000000001e-06 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781730+0000", 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156739 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781757+0000", 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6879000000000001e-05 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053853290000000003 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787177+0000", 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4793999999999999e-05 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.900567891999998, 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055938059999999998, 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.812 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781586+0000", 2023-11-19T00:40:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3999999999999997e-07 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781591+0000", 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9849999999999997e-06 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781599+0000", 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.525e-06 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781615+0000", 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6079e-05 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781845+0000", 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022970799999999999 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781864+0000", 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9375999999999999e-05 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787142+0000", 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052779059999999997 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787180+0000", 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7886999999999998e-05 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "pg_update_log_missing(3.14 epoch 18/16 rep_tid 168 entries 18'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.900347816999997, 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0053900069999999996, 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781806+0000", 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781807+0000", 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1399999999999998e-07 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781840+0000", 2023-11-19T00:40:02.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3027000000000001e-05 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781853+0000", 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3910999999999999e-05 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781866+0000", 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2811e-05 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782178+0000", 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031209899999999998 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787196+0000", 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050178449999999999 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:9 3.10 e18/16 3:09401a81:::601.00000000:head v 18'4, mlcod=0'0)", 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:40:02.820 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.900224440000002, 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00528218, 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781930+0000", 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6399999999999998e-07 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781935+0000", 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7160000000000002e-06 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781943+0000", 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1100000000000003e-06 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781948+0000", 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5509999999999999e-06 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.781989+0000", 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0742999999999999e-05 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.782011+0000", 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1858e-05 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787179+0000", 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051677959999999997 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.787212+0000", 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3142000000000002e-05 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=0'0)", 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.898353994999994, 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062034780000000001, 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:40:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783800+0000", 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9900000000000001e-07 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783807+0000", 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3459999999999999e-06 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783816+0000", 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3729999999999999e-06 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783831+0000", 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4419999999999999e-05 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783972+0000", 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014181099999999999 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4153e-05 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.789956+0000", 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059695260000000002 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.790004+0000", 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7450000000000001e-05 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.6311189160000001, 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.829 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:02.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2633 4.1c 4:39be8b5c:::10000000c6c.00000000:head [write 0~1373] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.340546+0000", 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.34160806599999999, 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052157059999999996, 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.835 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2633 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340546+0000", 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340546+0000", 2023-11-19T00:40:02.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340547+0000", 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3200000000000004e-07 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340550+0000", 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5899999999999999e-06 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340558+0000", 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5739999999999998e-06 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340562+0000", 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4120000000000003e-06 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340597+0000", 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4270000000000002e-05 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340669+0000", 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2148000000000001e-05 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.340745+0000", 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6542e-05 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.341249+0000", 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050400900000000003 2023-11-19T00:40:02.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.345689+0000", 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044400330000000003 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.345721+0000", 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1424000000000003e-05 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.345762+0000", 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0972e-05 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:95 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~1924058 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e41)", 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.628965+0000", 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.053189476999999999, 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070984890000000004, 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:02.841 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.628965+0000", 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.628965+0000", 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:02.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.628966+0000", 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.252e-06 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.631590+0000", 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026241440000000001 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.631603+0000", 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3173000000000001e-05 2023-11-19T00:40:02.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.631611+0000", 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4680000000000003e-06 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.631689+0000", 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8831999999999993e-05 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:02.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.631743+0000", 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3644999999999999e-05 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.631823+0000", 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9772999999999997e-05 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.634335+0000", 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025125350000000002 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.636006+0000", 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001670824 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.636039+0000", 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2325e-05 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.636063+0000", 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4518000000000001e-05 2023-11-19T00:40:02.846 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.847 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:02.847 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:02.847 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:02.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:40:02.849 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:02.847+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:02.850 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:02.949 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:02.947+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:02.961 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4570.0:3314 4.e 4:728a05b8:::10000000f1a.00000000:head [write 0~525 in=525b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:02.961217+0000", 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.00051606799999999995, 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00053990899999999998, 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "waiting for sub ops", 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4570", 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 3314 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961217+0000", 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961217+0000", 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961217+0000", 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.58e-07 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961220+0000", 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4590000000000001e-06 2023-11-19T00:40:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961226+0000", 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7769999999999997e-06 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961230+0000", 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1269999999999996e-06 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961269+0000", 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8081999999999999e-05 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961379+0000", 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110061 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:02.961501+0000", 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012249 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2023-11-19T00:40:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 1 2023-11-19T00:40:02.967 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:02.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:03.050 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:03.049+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:03.133 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:03.133 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:03.143 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:03.186 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:03.185+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:03.252 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:03.250+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:03.256 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 88.624476759000004, 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 87.098777982000001, 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:40:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:40:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 87.098664166000006, 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 87.098638776000001, 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.697863049000006, 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.487059705999997, 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.486568988000002, 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:03.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.301 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.486516365, 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:03.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:03.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:03.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.485039916000005, 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.308 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:03.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.314 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484995656999999, 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:03.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:03.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:03.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:03.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:03.321 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484953253, 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:03.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:03.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484906412000001, 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:03.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.334 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484835165000007, 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:03.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:03.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484638728999997, 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:03.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:03.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:03.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484586977999996, 2023-11-19T00:40:03.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:03.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:03.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.353 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484381529000004, 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:03.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:03.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.484330592999996, 2023-11-19T00:40:03.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:03.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:03.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.483892210999997, 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:03.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:03.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.483855082999995, 2023-11-19T00:40:03.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:03.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.379 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.483794298999996, 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:03.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:03.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:03.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:03.385 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:03.385 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:03.386 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:03.385+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:03.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:03.486 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:03.486+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:03.512 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:03.512 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:03.512 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:03.512 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:03.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:03.605 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:03.605+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:03.674 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:03.674 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:03.674 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:03.674 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:03.675 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:03.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:03.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:40:03.725 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:03.724+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:03.783 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:40:03.790 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:03.788+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:03.807 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 25% (1094/4211) Updating files: 26% (1095/4211) Updating files: 27% (1137/4211) Updating files: 28% (1180/4211) Updating files: 29% (1222/4211) Updating files: 30% (1264/4211) Updating files: 31% (1306/4211) Updating files: 32% (1348/4211) Updating files: 33% (1390/4211) Updating files: 34% (1432/4211) Updating files: 35% (1474/4211) Updating files: 36% (1516/4211) Updating files: 37% (1559/4211) Updating files: 38% (1601/4211) Updating files: 39% (1643/4211) Updating files: 40% (1685/4211) Updating files: 41% (1727/4211) Updating files: 42% (1769/4211) Updating files: 43% (1811/4211) Updating files: 44% (1853/4211) Updating files: 45% (1895/4211) Updating files: 46% (1938/4211) Updating files: 47% (1980/4211) Updating files: 48% (2022/4211) Updating files: 49% (2064/4211) Updating files: 50% (2106/4211) Updating files: 51% (2148/4211) Updating files: 52% (2190/4211) Updating files: 52% (2220/4211) Updating files: 53% (2232/4211) Updating files: 54% (2274/4211) Updating files: 55% (2317/4211) Updating files: 56% (2359/4211) Updating files: 57% (2401/4211) Updating files: 58% (2443/4211) Updating files: 59% (2485/4211) Updating files: 60% (2527/4211) Updating files: 61% (2569/4211) Updating files: 62% (2611/4211) Updating files: 63% (2653/4211) Updating files: 64% (2696/4211) Updating files: 65% (2738/4211) Updating files: 66% (2780/4211) Updating files: 67% (2822/4211) Updating files: 68% (2864/4211) Updating files: 69% (2906/4211) Updating files: 70% (2948/4211) Updating files: 71% (2990/4211) Updating files: 72% (3032/4211) Updating files: 73% (3075/4211) Updating files: 74% (3117/4211) Updating files: 75% (3159/4211) Updating files: 76% (3201/4211) Updating files: 77% (3243/4211) Updating files: 78% (3285/4211) Updating files: 79% (3327/4211) Updating files: 79% (3337/4211) Updating files: 80% (3369/4211) Updating files: 81% (3411/4211) Updating files: 82% (3454/4211) Updating files: 83% (3496/4211) Updating files: 84% (3538/4211) Updating files: 85% (3580/4211) Updating files: 86% (3622/4211) Updating files: 87% (3664/4211) Updating files: 88% (3706/4211) Updating files: 89% (3748/4211) Updating files: 90% (3790/4211) Updating files: 91% (3833/4211) Updating files: 92% (3875/4211) Updating files: 93% (3917/4211) Updating files: 94% (3959/4211) Updating files: 95% (4001/4211) Updating files: 96% (4043/4211) Updating files: 97% (4085/4211) Updating files: 98% (4127/4211) Updating files: 99% (4169/4211) Updating files: 100% (4211/4211) Updating files: 100% (4211/4211), done. 2023-11-19T00:40:03.815 INFO:tasks.workunit.client.0.smithi046.stderr:+ cd xfstests-dev 2023-11-19T00:40:03.816 INFO:tasks.workunit.client.0.smithi046.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2023-11-19T00:40:03.837 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:03.837 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:03.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 2.0553916160000001, 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.838 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:03.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:03.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:03.844 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 2.0508049499999998, 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.845 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:03.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:03.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 2.029619104, 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.852 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:03.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:03.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.859 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.994982783, 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:03.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:03.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.968906619, 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:03.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:03.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.934105116, 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.874 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:03.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:03.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:03.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.9258963099999999, 2023-11-19T00:40:03.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:03.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.9250537350000001, 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:03.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:03.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.8375860980000001, 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:03.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:03.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.814656995, 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:03.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:03.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:03.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:03.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.802901104, 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.909 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:03.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:03.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:03.915 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.7822829869999999, 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.916 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:03.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:03.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:03.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.7805419329999999, 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.923 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:03.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:03.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.7509538739999999, 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.930 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:03.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:03.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.726006742, 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.937 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:03.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:03.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.6994910920000001, 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.944 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:03.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:03.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.6823392269999999, 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.672243438, 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:03.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.959 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.959 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.959 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.959 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:03.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:03.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:03.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.662882623, 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.967 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:03.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:03.973 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.6499051680000001, 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:03.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:03.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:03.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:03.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:03.980 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:03.981 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:03.982 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:03.982 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:03.982 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:03.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:03.983 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:03.984 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:03.985 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:03.980+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:04.083 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:04.082+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:04.089 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.089 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.098 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:04.183 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:04.183+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:04.202 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.202 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.211 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:04.285 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:04.284+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.365 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:04.385 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:04.385+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:04.475 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.476 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.484 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:04.485 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:04.485+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:04.586 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:04.586+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:04.589 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.589 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.598 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:04.688 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:04.687+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:04.703 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.703 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:04.789 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:04.788+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:04.819 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.820 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:04.889 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:04.889+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:04.935 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:04.935 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:04.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:04.990 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:04.989+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:05.048 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:05.048 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:05.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:05.101 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:05.100+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:05.173 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:05.173 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:05.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:05.223 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:05.222+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:05.293 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:05.292+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:05.326 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:05.327 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:05.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:05.419 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:05.418+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:05.479 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:05.479 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:05.488 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:05.531 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:05.530+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:05.595 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:05.595+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:05.609 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:05.609 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:05.619 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:05.696 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:05.695+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:05.772 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:05.772 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:05.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:05.797 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:05.796+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:05.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:40:05.893 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:05.894 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:05.898 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:05.897+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:05.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:05.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:06.000 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:05.999+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:06.019 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:06.020 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:06.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:06.100 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:06.099+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:06.139 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:06.139 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:06.140 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:06.140 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:06.140 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:06.140 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:06.140 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:06.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:06.162 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:06.184 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:06.201 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:06.200+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:06.262 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:06.263 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:06.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:06.263 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:06.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.263 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.263 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.4802902949999996, 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:06.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:06.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:06.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:06.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:06.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.4757036289999999, 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.454517783, 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.4198814620000002, 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.3938052980000002, 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.3590037949999996, 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.3507949889999997, 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:06.321 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:06.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:06.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.328 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.3499524139999997, 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:06.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.2624847770000001, 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:06.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:06.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:06.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.342 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.343 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.343 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.343 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:06.343 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.239555674, 2023-11-19T00:40:06.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:06.344 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.344 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.344 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.344 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.345 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.345 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:06.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.345 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:06.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:06.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:06.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:06.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:06.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:06.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:06.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:06.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:06.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:06.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:06.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.227799783, 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:06.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:06.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:06.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.2071816660000003, 2023-11-19T00:40:06.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:06.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:06.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:06.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:06.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:06.369 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.2054406120000003, 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.370 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:06.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:06.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.1758525530000004, 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:06.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:06.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:06.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.384 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.150905421, 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:06.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:06.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:06.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.1243897709999997, 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:06.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:06.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:06.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:06.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.1072379059999999, 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.400 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:06.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:06.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:06.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0971421169999998, 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:06.407 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:06.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0877813019999998, 2023-11-19T00:40:06.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:06.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0748038470000001, 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.423 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:06.425 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:06.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:06.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:06.431 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:06.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:06.433 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:06.431+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:06.533 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:06.532+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:06.542 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:06.542 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:06.542 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:06.542 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:06.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:06.634 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:06.633+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:06.700 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:06.700 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:06.700 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:06.701 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:06.701 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:06.709 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:06.753 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:06.753+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:06.782 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:40:06.789 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:40:06.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:40:06.789 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2023-11-19T00:40:06.790 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-11-19T00:40:06.790 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-11-19T00:40:06.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2023-11-19T00:40:06.821 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.050580921999995, 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089589590000000007, 2023-11-19T00:40:06.822 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.823 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.823 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:40:06.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769073+0000", 2023-11-19T00:40:06.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769074+0000", 2023-11-19T00:40:06.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4499999999999996e-07 2023-11-19T00:40:06.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769080+0000", 2023-11-19T00:40:06.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9649999999999996e-06 2023-11-19T00:40:06.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769088+0000", 2023-11-19T00:40:06.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2479999999999996e-06 2023-11-19T00:40:06.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769097+0000", 2023-11-19T00:40:06.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2209999999999997e-06 2023-11-19T00:40:06.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769976+0000", 2023-11-19T00:40:06.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000879385 2023-11-19T00:40:06.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014106399999999999 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770289+0000", 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017146800000000001 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771986+0000", 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001697439 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777928+0000", 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059419360000000001 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777984+0000", 2023-11-19T00:40:06.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5980000000000003e-05 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778032+0000", 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8408000000000001e-05 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.050534029999994, 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087281200000000007, 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:40:06.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769120+0000", 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769121+0000", 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4099999999999999e-07 2023-11-19T00:40:06.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769126+0000", 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8590000000000004e-06 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769134+0000", 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9899999999999997e-06 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769142+0000", 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5310000000000001e-06 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769911+0000", 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076930100000000001 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770025+0000", 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113096 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770176+0000", 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015165900000000001 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771459+0000", 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00128232 2023-11-19T00:40:06.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777767+0000", 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0063081020000000003 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777811+0000", 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4688000000000003e-05 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777848+0000", 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7033000000000003e-05 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.050494310999994, 2023-11-19T00:40:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089057849999999994, 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769160+0000", 2023-11-19T00:40:06.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2e-07 2023-11-19T00:40:06.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769165+0000", 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6569999999999996e-06 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769173+0000", 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:40:06.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769179+0000", 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7769999999999999e-06 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770448+0000", 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001268618 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770549+0000", 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101878 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770718+0000", 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000168333 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.771992+0000", 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001274533 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777972+0000", 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059800900000000004 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778029+0000", 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6227000000000002e-05 2023-11-19T00:40:06.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778066+0000", 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7089999999999999e-05 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:06.846 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.050253417999997, 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088834380000000004, 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769401+0000", 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769402+0000", 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4200000000000004e-07 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769407+0000", 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6899999999999997e-06 2023-11-19T00:40:06.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769416+0000", 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2290000000000003e-06 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769422+0000", 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1870000000000002e-06 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770686+0000", 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012638770000000001 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770834+0000", 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014804099999999999 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.770978+0000", 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143814 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.773027+0000", 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020495019999999999 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778098+0000", 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005070799 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778184+0000", 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5851000000000002e-05 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.778284+0000", 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100506 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.050225234999999, 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079559179999999993, 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769429+0000", 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1600000000000002e-07 2023-11-19T00:40:06.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769431+0000", 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769439+0000", 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7249999999999997e-06 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769444+0000", 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769487+0000", 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3226999999999998e-05 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.769753+0000", 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026554699999999998 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:38:44.777385+0000", 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076319459999999997 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.857 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.7686191280000001, 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:06.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.0129449399999997, 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:06.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:06.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:06.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:06.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.9504811640000002, 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.872 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:06.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:06.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.879 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.8499018149999999, 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:06.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:06.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.886 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6845910360000005, 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.887 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:06.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:06.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6690718860000002, 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.895 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:06.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.902 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.603280796, 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:06.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.4234071119999996, 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:06.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:06.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.3503024559999997, 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:06.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:06.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.924 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.2986052959999999, 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:06.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.2642143170000004, 2023-11-19T00:40:06.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:06.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:06.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.2537701109999997, 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.939 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:06.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:06.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.2329130399999997, 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.946 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:06.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:06.953 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.0711118480000001, 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:06.954 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.46294637, 2023-11-19T00:40:06.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:06.968 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:06.969 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:06.968+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:06.970 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2023-11-19T00:40:06.970 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:06.970 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:07.070 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:07.069+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:07.080 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:07.080 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:07.080 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:07.080 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:07.089 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:07.171 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:07.170+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:07.241 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:07.241 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:07.241 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:07.241 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:07.241 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:07.250 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:07.271 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:07.271+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:07.363 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:07.363 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:07.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:07.363 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:07.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.363 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:07.363 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 92.730959783000003, 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:07.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:07.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:07.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:07.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:07.371 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.205261006000001, 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012653311, 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 137 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155803+0000", 2023-11-19T00:40:07.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9999999999999999e-07 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155868+0000", 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5192999999999997e-05 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155873+0000", 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1869999999999996e-06 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155878+0000", 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5199999999999999e-06 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160127+0000", 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042490699999999998 2023-11-19T00:40:07.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160174+0000", 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7051000000000001e-05 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.160287+0000", 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011325800000000001 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163369+0000", 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030820159999999999 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168366+0000", 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004996271 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168413+0000", 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7679999999999998e-05 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168456+0000", 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2864999999999997e-05 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.205147190000005, 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.205121800000001, 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.804346073000005, 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.593542729999996, 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.593052012000001, 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.592999388999999, 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.591522940000004, 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:07.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.591478680999998, 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.591436277, 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.591389436, 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.591318189000006, 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.591121752999996, 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.591070001999995, 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.590864553000003, 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:07.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:07.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:07.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.590813616999995, 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.482 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:07.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:07.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.590375234999996, 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.489 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:07.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:07.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.590338106999994, 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:07.496 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:07.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:07.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.590277322999995, 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:07.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:07.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:07.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.509 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:07.509 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:07.509 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:07.510 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:07.509+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:07.511 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:07.611 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:07.610+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:07.628 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:07.628 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:07.629 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:07.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:07.712 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:07.711+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:07.788 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:07.788 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:07.789 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:07.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:07.813 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:07.813+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:07.914 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:07.913+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:07.952 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:07.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.169000853, 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:07.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:07.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:07.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:07.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:07.960 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.1644141870000002, 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:07.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:07.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:07.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:07.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:07.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.1432283410000004, 2023-11-19T00:40:07.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:07.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:07.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:07.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:07.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:07.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.1085920199999997, 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:07.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:07.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:07.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:07.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.0825158559999997, 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:07.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:07.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:07.991 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.0477143529999999, 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:07.992 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:07.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:07.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:07.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:07.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:07.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:07.999 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.0395055470000001, 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.000 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:08.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:08.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.038662972, 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:08.008 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:08.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:08.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:08.015 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9511953349999995, 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.016 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:08.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:08.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9282662320000004, 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.024 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:08.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:08.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:08.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9165103410000004, 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.032 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:08.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:08.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:08.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.8958922239999998, 2023-11-19T00:40:08.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:08.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:08.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:08.046 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.8941511699999998, 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.047 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:08.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:08.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.8645631109999998, 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:08.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:08.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:08.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:08.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.062 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.8396159789999995, 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:08.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.8131003290000001, 2023-11-19T00:40:08.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:08.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:08.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:08.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:08.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.7959484640000003, 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:08.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:08.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.085 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.7858526750000001, 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.086 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:08.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:08.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:08.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.093 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.7764918600000001, 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.094 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:08.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:08.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.7635144050000005, 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:08.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:08.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:08.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:08.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:08.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:08.109 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:08.111 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:08.111 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:08.110+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-19T00:40:08.120 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr: 2023-11-19T00:40:08.121 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2023-11-19T00:40:08.123 INFO:tasks.workunit.client.0.smithi046.stderr:+ make -j4 2023-11-19T00:40:08.138 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize -cfi 2023-11-19T00:40:08.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:40:08.211 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:08.211+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:08.216 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:08.216 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:08.216 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:08.216 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:08.224 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:08.313 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:08.312+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:08.324 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:08.325 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:08.343 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:08.361 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:08.361 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:08.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:08.421 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:08.421+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:08.483 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:08.483 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:08.492 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:08.513 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-19T00:40:08.513 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './config.guess' 2023-11-19T00:40:08.521 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './config.sub' 2023-11-19T00:40:08.527 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './install-sh' 2023-11-19T00:40:08.534 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './ltmain.sh' 2023-11-19T00:40:08.535 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:08.535+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:08.564 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-19T00:40:08.564 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-19T00:40:08.571 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-19T00:40:08.578 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-19T00:40:08.585 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-19T00:40:08.592 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-19T00:40:08.599 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:08.599 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:08.600 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-19T00:40:08.602 INFO:tasks.workunit.client.0.smithi046.stdout:cp include/install-sh . 2023-11-19T00:40:08.608 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:08.609 INFO:tasks.workunit.client.0.smithi046.stdout:aclocal -I m4 2023-11-19T00:40:08.649 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:08.649+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:08.715 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:08.715+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:08.754 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:08.754 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:08.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:08.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:40:08.816 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:08.815+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:08.917 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:08.917+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:08.920 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:08.920 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:08.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:09.018 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:09.018+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:09.034 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.034 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:09.119 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:09.119+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:09.148 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.148 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:09.220 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:09.220+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:09.262 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.262 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:09.321 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:09.321+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:09.379 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.380 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.388 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:09.422 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:09.421+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:09.492 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.493 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:09.523 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:09.522+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:09.606 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.606 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:09.623 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:09.623+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:09.724 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:09.724+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:09.725 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.725 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.734 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:40:09.803 INFO:tasks.workunit.client.0.smithi046.stdout:autoheader 2023-11-19T00:40:09.825 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:09.825+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:09.851 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.851 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:09.864 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:09.926 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:09.926+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:09.993 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:09.993 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:10.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:10.027 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:10.026+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:10.108 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:10.108 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:10.117 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:10.128 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:10.127+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:10.147 INFO:tasks.workunit.client.0.smithi046.stdout:autoconf 2023-11-19T00:40:10.220 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:10.220 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:10.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:10.229 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:10.228+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:10.330 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:10.329+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:10.335 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:10.335 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:10.343 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:10.354 INFO:tasks.workunit.client.0.smithi046.stdout:./configure \ 2023-11-19T00:40:10.355 INFO:tasks.workunit.client.0.smithi046.stdout: --libexecdir=/usr/lib \ 2023-11-19T00:40:10.355 INFO:tasks.workunit.client.0.smithi046.stdout: --exec_prefix=/var/lib 2023-11-19T00:40:10.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:10.431 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:10.430+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:10.453 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:10.453 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:10.462 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:10.508 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:10.508 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:10.509 INFO:tasks.workunit.client.0.smithi046.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-19T00:40:10.509 INFO:tasks.workunit.client.0.smithi046.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-19T00:40:10.511 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to print strings... printf 2023-11-19T00:40:10.512 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc... gcc 2023-11-19T00:40:10.528 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:10.529 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:10.532 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:10.531+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:10.548 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:10.548 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:10.567 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:10.568 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:10.576 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:10.589 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether the C compiler works... yes 2023-11-19T00:40:10.589 INFO:tasks.workunit.client.0.smithi046.stdout:checking for C compiler default output file name... a.out 2023-11-19T00:40:10.632 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:10.632+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:10.633 INFO:tasks.workunit.client.0.smithi046.stdout:checking for suffix of executables... 2023-11-19T00:40:10.679 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether we are cross compiling... no 2023-11-19T00:40:10.683 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:10.683 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:10.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:10.683 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 11.630515076, 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.684 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:10.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:10.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:10.690 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.8748408879999996, 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:10.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:10.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.8123771120000001, 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:10.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:10.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:10.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.7117977629999999, 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:10.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:10.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:10.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:10.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5464869839999995, 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.713 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:10.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.5309678340000001, 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:10.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:10.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:10.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.729 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.4651767440000008, 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:10.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:10.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:10.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.2853030600000004, 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:10.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:10.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:10.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.2121984040000005, 2023-11-19T00:40:10.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:10.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:10.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.1605012440000007, 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:10.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:10.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.1261102649999994, 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:10.759 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:10.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:10.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.1156660590000005, 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.767 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:10.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:10.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.0948089880000005, 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:10.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:10.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:10.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.781 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 7.9330077960000001, 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:10.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:10.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:10.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:10.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.324842318, 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:10.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:10.795 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.6774780790000001, 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:10.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.8633736130000003, 2023-11-19T00:40:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:10.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:10.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:228 4.8 4:11cbfb37:::1000000065c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.8569299180000001, 2023-11-19T00:40:10.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013114463999999999, 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824621+0000", 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1099999999999995e-07 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824636+0000", 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4899000000000001e-05 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824644+0000", 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4209999999999995e-06 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824652+0000", 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8809999999999996e-06 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825206+0000", 2023-11-19T00:40:10.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055371499999999998 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825362+0000", 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156169 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825472+0000", 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110188 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827381+0000", 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001908365 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837644+0000", 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010263627000000001 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837701+0000", 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6560000000000001e-05 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837735+0000", 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3927999999999998e-05 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:257 4.2 4:40f27d78:::10000000546.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:10.812 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.8563106080000003, 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012604687, 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8299999999999998e-07 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825241+0000", 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4139999999999999e-06 2023-11-19T00:40:10.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825248+0000", 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3090000000000001e-06 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825252+0000", 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7419999999999997e-06 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826682+0000", 2023-11-19T00:40:10.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00142939 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826787+0000", 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105624 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826884+0000", 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6658999999999997e-05 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827750+0000", 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086578700000000002 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837768+0000", 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010018144999999999 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837819+0000", 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0849000000000001e-05 2023-11-19T00:40:10.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837844+0000", 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5485000000000001e-05 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:268 4.22 4:451df306:::10000000551.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.8562701700000002, 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012664776000000001, 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.27e-07 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825283+0000", 2023-11-19T00:40:10.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1350000000000001e-06 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825289+0000", 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9460000000000003e-06 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825295+0000", 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1719999999999998e-06 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827106+0000", 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018117020000000001 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827242+0000", 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000135582 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827325+0000", 2023-11-19T00:40:10.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3222999999999999e-05 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.828145+0000", 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081991900000000001 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837875+0000", 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097303579999999997 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837917+0000", 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1538000000000001e-05 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837945+0000", 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7874000000000001e-05 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:10.825 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:10.833 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:10.826+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:10.834 INFO:tasks.workunit.client.0.smithi046.stdout:checking for suffix of object files... o 2023-11-19T00:40:10.834 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether we are using the GNU C compiler... yes 2023-11-19T00:40:10.834 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether gcc accepts -g... yes 2023-11-19T00:40:10.834 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:10.855 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc option to accept ISO C89... none needed 2023-11-19T00:40:10.859 INFO:tasks.workunit.client.0.smithi046.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-19T00:40:10.862 INFO:tasks.workunit.client.0.smithi046.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-19T00:40:10.863 INFO:tasks.workunit.client.0.smithi046.stdout:checking for egrep... /usr/bin/grep -E 2023-11-19T00:40:10.864 INFO:tasks.workunit.client.0.smithi046.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-19T00:40:10.868 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-19T00:40:10.870 INFO:tasks.workunit.client.0.smithi046.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-19T00:40:10.877 INFO:tasks.workunit.client.0.smithi046.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-19T00:40:10.927 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:10.927+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:10.942 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:10.942 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:10.942 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:10.942 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:10.951 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:11.028 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:11.027+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:11.056 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:11.056 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:11.056 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:11.056 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:11.056 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:11.064 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:11.129 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:11.129+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 96.539805251999994, 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:11.172 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:11.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:11.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.013992658999996, 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:11.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:11.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:11.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.187 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.013967269000005, 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:11.188 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:11.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:11.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:11.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:11.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:11.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:11.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.195 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.613191541999996, 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:11.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:11.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:11.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.203 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.402388199000001, 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:11.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:11.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:11.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:11.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.211 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.401897481000006, 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:11.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:11.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.401844858000004, 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:11.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.400368408999995, 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:11.226 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:11.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:11.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:11.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:11.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:11.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:11.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:11.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:11.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:11.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:11.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:11.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:11.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:11.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:11.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:11.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:11.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:11.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:11.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:11.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:11.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:11.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.240 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.240 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:11.240 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.400324150000003, 2023-11-19T00:40:11.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:11.241 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.241 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.241 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:11.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:11.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.248 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.400281746000005, 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:11.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:11.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.400234905000005, 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:11.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:11.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:11.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:11.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:11.263 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.400163657999997, 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:11.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:11.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:11.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.399967222000001, 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:11.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:11.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.399915471, 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:11.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:11.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:11.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.399710021999994, 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:11.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:11.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:11.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:11.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.399659086, 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:11.292 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:11.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:11.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:11.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:11.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:11.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:11.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:11.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.399220704000001, 2023-11-19T00:40:11.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:11.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:11.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:11.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:11.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:11.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.399183575999999, 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.399122792, 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 3.3445187650000001, 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:11.328 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:11.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:11.331 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:11.329+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:11.430 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:11.430+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:11.442 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:11.442 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:11.442 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:11.442 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:11.451 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:11.531 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:11.531+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:11.556 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:11.556 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:11.556 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:11.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:11.632 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:11.631+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:11.671 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:11.671 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:11.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:11.671 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:11.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.8888918560000008, 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.672 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:11.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:11.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:11.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:11.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:11.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:11.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:11.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:11.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:11.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:11.682 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.8843051899999992, 2023-11-19T00:40:11.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:11.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.683 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.683 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.683 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.683 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.684 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:11.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.684 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:11.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:11.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:11.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:11.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:11.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:11.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:11.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:11.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:11.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:11.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:11.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:11.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:11.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:11.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:11.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:11.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:11.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:11.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:11.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:11.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:11.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:11.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:11.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:11.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:11.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:11.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:11.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:11.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.710 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.710 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.710 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.8631193439999993, 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:11.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:11.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:11.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:11.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:11.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:11.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:11.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:11.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:11.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.8284830230000004, 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.721 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:11.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.728 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.8024068589999995, 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.729 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:11.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:11.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.7676053560000007, 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.736 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:11.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:11.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.742 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.7593965499999999, 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:11.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:11.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:11.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:11.749 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.7585539749999999, 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:11.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.6710863380000003, 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.756 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:11.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:11.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.6481572349999993, 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:11.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:11.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.769 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.6364013439999994, 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:11.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:11.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.6157832269999997, 2023-11-19T00:40:11.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:11.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:11.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.6140421729999996, 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.783 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:11.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:11.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5844541139999997, 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.790 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:11.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:11.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.797 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5595069820000003, 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:11.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:11.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:11.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5329913319999999, 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:11.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:11.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:11.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:11.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.812 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5158394669999993, 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.813 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:11.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:11.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:11.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:11.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.505743678, 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.823 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:11.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:11.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.830 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4963828630000009, 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:11.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:11.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4834054079999994, 2023-11-19T00:40:11.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:11.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:11.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:11.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:11.845 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.846 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:11.846 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:11.846 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:11.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:40:11.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:11.849 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:11.847+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether ln -s works... yes 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking the maximum length of command line arguments... 1572864 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking for objdump... objdump 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to recognize dependent libraries... pass_all 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking for dlltool... no 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-19T00:40:11.851 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ar... ar 2023-11-19T00:40:11.884 INFO:tasks.workunit.client.0.smithi046.stdout:checking for archiver @FILE support... @ 2023-11-19T00:40:11.885 INFO:tasks.workunit.client.0.smithi046.stdout:checking for strip... strip 2023-11-19T00:40:11.886 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ranlib... ranlib 2023-11-19T00:40:11.887 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gawk... gawk 2023-11-19T00:40:11.949 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:11.948+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:11.966 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:11.966 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:11.967 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:11.967 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:11.972 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:40:11.972 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:40:11.972 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-11-19T00:40:11.972 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2023-11-19T00:40:11.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2023-11-19T00:40:11.975 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:12.006 INFO:tasks.workunit.client.0.smithi046.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-19T00:40:12.008 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sysroot... no 2023-11-19T00:40:12.018 INFO:tasks.workunit.client.0.smithi046.stdout:checking for a working dd... /usr/bin/dd 2023-11-19T00:40:12.027 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-19T00:40:12.049 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:12.049+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:12.052 INFO:tasks.workunit.client.0.smithi046.stdout:checking for mt... no 2023-11-19T00:40:12.060 INFO:tasks.workunit.client.0.smithi046.stdout:checking if : is a manifest tool... no 2023-11-19T00:40:12.083 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:12.083 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:12.084 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:12.084 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:12.084 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:12.092 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:12.139 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to run the C preprocessor... gcc -E 2023-11-19T00:40:12.150 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:12.150+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:12.240 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:12.240 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:12.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:12.241 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:12.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.241 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:12.242 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:12.242 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.187306435, 2023-11-19T00:40:12.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:12.242 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.242 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.242 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:12.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:12.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:12.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:12.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:12.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:12.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:12.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:12.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:12.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:12.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:12.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:12.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:12.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:12.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:12.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:12.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:12.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:12.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:12.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:12.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:12.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:12.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:12.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.260 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:12.260 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.431632247, 2023-11-19T00:40:12.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:12.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.260 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.261 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:12.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.261 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:12.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:12.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:12.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:12.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:12.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:12.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:12.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:12.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:12.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:12.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:12.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:12.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:12.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:12.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:12.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:12.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:12.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:12.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:12.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:12.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:12.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:12.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:12.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:12.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.277 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.277 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:12.277 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.369168471, 2023-11-19T00:40:12.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:12.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:12.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:12.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:12.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:12.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:12.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:12.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:12.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:12.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:12.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:12.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:12.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:12.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:12.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:12.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:12.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:12.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:12.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:12.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:12.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:12.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:12.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:12.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:12.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:12.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.291 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.268589122, 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:12.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:12.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.103278342999999, 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.300 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:12.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:12.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:12.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:12.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:12.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:12.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:12.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:12.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:12.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:12.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:12.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:12.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:12.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:12.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:12.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:12.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:12.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:12.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:12.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:12.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:12.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:12.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:12.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:12.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.313 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.314 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.314 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:12.314 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.087759193, 2023-11-19T00:40:12.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:12.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.315 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.315 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.315 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.315 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.315 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:12.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.316 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:12.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:12.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:12.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:12.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:12.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:12.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:12.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:12.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:12.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:12.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:12.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:12.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:12.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:12.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:12.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:12.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:12.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:12.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.021968103000001, 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:12.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:12.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:12.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:12.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:12.335 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.8420944190000004, 2023-11-19T00:40:12.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:12.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.336 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.337 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:12.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:12.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:12.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:12.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:12.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:12.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:12.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:12.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:12.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:12.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:12.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:12.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:12.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:12.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:12.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:12.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:12.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:12.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:12.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:12.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:12.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:12.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:12.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:12.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:12.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:12.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:12.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:12.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.7689897630000004, 2023-11-19T00:40:12.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:12.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.352 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:12.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:12.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:12.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:12.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:12.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:12.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:12.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:12.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:12.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:12.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:12.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:12.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:12.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:12.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:12.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:12.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:12.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:12.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:12.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:12.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:12.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:12.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:12.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:12.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:12.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:12.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:12.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:12.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:12.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.365 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.366 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.366 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:12.366 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.7172926030000006, 2023-11-19T00:40:12.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:12.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.367 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.367 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.368 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.368 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:12.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.368 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:12.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:12.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:12.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:12.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:12.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:12.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:12.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:12.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:12.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:12.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:12.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:12.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:12.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:12.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:12.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.384 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.6829016239999994, 2023-11-19T00:40:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.385 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:12.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:12.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:12.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:12.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:12.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:12.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:12.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:12.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:12.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:12.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:12.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:12.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:12.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:12.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:12.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:12.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.6724574180000005, 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.399 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:12.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:12.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:12.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:12.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:12.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.6516003470000005, 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.407 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:12.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:12.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.489799155, 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:12.415 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:12.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:12.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:12.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.422 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.8816336769999999, 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:12.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:12.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.2342694380000001, 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.429 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:12.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.4201649720000002, 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:12.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:12.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:12.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:228 4.8 4:11cbfb37:::1000000065c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.4137212769999996, 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013114463999999999, 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824621+0000", 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1099999999999995e-07 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824636+0000", 2023-11-19T00:40:12.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4899000000000001e-05 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824644+0000", 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4209999999999995e-06 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824652+0000", 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8809999999999996e-06 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825206+0000", 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055371499999999998 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825362+0000", 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156169 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825472+0000", 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110188 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827381+0000", 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001908365 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837644+0000", 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010263627000000001 2023-11-19T00:40:12.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837701+0000", 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6560000000000001e-05 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837735+0000", 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3927999999999998e-05 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:257 4.2 4:40f27d78:::10000000546.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.4131019670000002, 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012604687, 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8299999999999998e-07 2023-11-19T00:40:12.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825241+0000", 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4139999999999999e-06 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825248+0000", 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3090000000000001e-06 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825252+0000", 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7419999999999997e-06 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826682+0000", 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00142939 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826787+0000", 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105624 2023-11-19T00:40:12.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826884+0000", 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6658999999999997e-05 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827750+0000", 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086578700000000002 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837768+0000", 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010018144999999999 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837819+0000", 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0849000000000001e-05 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837844+0000", 2023-11-19T00:40:12.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5485000000000001e-05 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:268 4.22 4:451df306:::10000000551.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.4130615290000001, 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012664776000000001, 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:12.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.27e-07 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825283+0000", 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1350000000000001e-06 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825289+0000", 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9460000000000003e-06 2023-11-19T00:40:12.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825295+0000", 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1719999999999998e-06 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827106+0000", 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018117020000000001 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827242+0000", 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000135582 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827325+0000", 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3222999999999999e-05 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.828145+0000", 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081991900000000001 2023-11-19T00:40:12.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837875+0000", 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097303579999999997 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837917+0000", 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1538000000000001e-05 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:12.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837945+0000", 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7874000000000001e-05 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:12.459 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:12.461 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:12.460+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:12.462 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:12.462 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ANSI C header files... yes 2023-11-19T00:40:12.462 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/types.h... yes 2023-11-19T00:40:12.462 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/stat.h... yes 2023-11-19T00:40:12.462 INFO:tasks.workunit.client.0.smithi046.stdout:checking for stdlib.h... yes 2023-11-19T00:40:12.471 INFO:tasks.workunit.client.0.smithi046.stdout:checking for string.h... yes 2023-11-19T00:40:12.517 INFO:tasks.workunit.client.0.smithi046.stdout:checking for memory.h... yes 2023-11-19T00:40:12.557 INFO:tasks.workunit.client.0.smithi046.stdout:checking for strings.h... yes 2023-11-19T00:40:12.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:40:12.562 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:12.561+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:12.569 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:12.569 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:12.569 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:12.570 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:12.579 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:12.601 INFO:tasks.workunit.client.0.smithi046.stdout:checking for inttypes.h... yes 2023-11-19T00:40:12.644 INFO:tasks.workunit.client.0.smithi046.stdout:checking for stdint.h... yes 2023-11-19T00:40:12.662 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:12.662+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:12.688 INFO:tasks.workunit.client.0.smithi046.stdout:checking for unistd.h... yes 2023-11-19T00:40:12.698 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:12.698 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:12.717 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:12.717 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:12.726 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:12.726 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:12.726 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:12.726 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:12.726 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:12.735 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:12.735 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:12.736 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:12.736 INFO:tasks.workunit.client.0.smithi046.stdout:checking for dlfcn.h... yes 2023-11-19T00:40:12.742 INFO:tasks.workunit.client.0.smithi046.stdout:checking for objdir... .libs 2023-11-19T00:40:12.763 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:12.762+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:12.790 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.1 primary-affinity to 0 (802) 2023-11-19T00:40:12.793 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:40:12.845 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:12.845 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:12.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:12.898 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:12.897+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:12.959 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:12.959 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:12.965 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:12.964+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:12.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:13.065 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:13.065+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:13.113 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:13.113 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:13.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:13.206 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:13.205+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:13.267 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:13.268 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:13.268 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:13.267+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:13.275 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:13.369 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:13.368+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:13.381 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:13.381 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:13.389 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:13.469 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:13.469+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:13.493 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:13.494 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:13.503 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:13.571 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:13.570+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:13.608 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:13.608 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:13.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:13.671 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:13.671+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:13.729 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:13.729 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:13.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:13.779 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:13.778+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:13.873 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:13.872+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:13.881 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-19T00:40:13.881 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-19T00:40:13.889 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:13.889 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:13.898 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:13.912 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-19T00:40:13.950 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc static flag -static works... no 2023-11-19T00:40:13.973 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:13.974+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:13.999 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc supports -c -o file.o... yes 2023-11-19T00:40:13.999 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-19T00:40:14.004 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.005 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.006 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-19T00:40:14.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:14.057 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether -lc should be explicitly linked in... no 2023-11-19T00:40:14.074 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:14.074+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:14.122 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.122 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:14.134 INFO:tasks.workunit.client.0.smithi046.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-19T00:40:14.135 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to hardcode library paths into programs... immediate 2023-11-19T00:40:14.136 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether stripping libraries is possible... yes 2023-11-19T00:40:14.137 INFO:tasks.workunit.client.0.smithi046.stdout:checking if libtool supports shared libraries... yes 2023-11-19T00:40:14.137 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether to build shared libraries... yes 2023-11-19T00:40:14.137 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether to build static libraries... yes 2023-11-19T00:40:14.145 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc... (cached) gcc 2023-11-19T00:40:14.174 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-11-19T00:40:14.174 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-19T00:40:14.175 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-11-19T00:40:14.175 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gmake... /usr/bin/gmake 2023-11-19T00:40:14.176 INFO:tasks.workunit.client.0.smithi046.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2023-11-19T00:40:14.176 INFO:tasks.workunit.client.0.smithi046.stdout:checking for tar... /bin/tar 2023-11-19T00:40:14.177 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gzip... /bin/gzip 2023-11-19T00:40:14.177 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:14.175+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:14.202 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether gcc -MM is supported... yes 2023-11-19T00:40:14.203 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sort... /bin/sort 2023-11-19T00:40:14.203 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether ln -s works... yes 2023-11-19T00:40:14.204 INFO:tasks.workunit.client.0.smithi046.stdout:checking for rpm... /bin/rpm 2023-11-19T00:40:14.208 INFO:tasks.workunit.client.0.smithi046.stdout:checking for rpmbuild... no 2023-11-19T00:40:14.208 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ANSI C header files... (cached) yes 2023-11-19T00:40:14.237 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.237 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:14.246 INFO:tasks.workunit.client.0.smithi046.stdout:checking assert.h usability... yes 2023-11-19T00:40:14.259 INFO:tasks.workunit.client.0.smithi046.stdout:checking assert.h presence... yes 2023-11-19T00:40:14.260 INFO:tasks.workunit.client.0.smithi046.stdout:checking for assert.h... yes 2023-11-19T00:40:14.276 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:14.276+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:14.304 INFO:tasks.workunit.client.0.smithi046.stdout:checking bstring.h usability... no 2023-11-19T00:40:14.326 INFO:tasks.workunit.client.0.smithi046.stdout:checking bstring.h presence... no 2023-11-19T00:40:14.326 INFO:tasks.workunit.client.0.smithi046.stdout:checking for bstring.h... no 2023-11-19T00:40:14.350 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.351 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:14.364 INFO:tasks.workunit.client.0.smithi046.stdout:checking libgen.h usability... yes 2023-11-19T00:40:14.377 INFO:tasks.workunit.client.0.smithi046.stdout:checking libgen.h presence... yes 2023-11-19T00:40:14.377 INFO:tasks.workunit.client.0.smithi046.stdout:checking for libgen.h... yes 2023-11-19T00:40:14.378 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:14.376+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:14.426 INFO:tasks.workunit.client.0.smithi046.stdout:checking dirent.h usability... yes 2023-11-19T00:40:14.439 INFO:tasks.workunit.client.0.smithi046.stdout:checking dirent.h presence... yes 2023-11-19T00:40:14.440 INFO:tasks.workunit.client.0.smithi046.stdout:checking for dirent.h... yes 2023-11-19T00:40:14.465 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.465 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:14.478 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:14.477+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:14.483 INFO:tasks.workunit.client.0.smithi046.stdout:checking errno.h usability... yes 2023-11-19T00:40:14.496 INFO:tasks.workunit.client.0.smithi046.stdout:checking errno.h presence... yes 2023-11-19T00:40:14.496 INFO:tasks.workunit.client.0.smithi046.stdout:checking for errno.h... yes 2023-11-19T00:40:14.547 INFO:tasks.workunit.client.0.smithi046.stdout:checking malloc.h usability... yes 2023-11-19T00:40:14.562 INFO:tasks.workunit.client.0.smithi046.stdout:checking malloc.h presence... yes 2023-11-19T00:40:14.562 INFO:tasks.workunit.client.0.smithi046.stdout:checking for malloc.h... yes 2023-11-19T00:40:14.578 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:14.578+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:14.579 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.579 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.588 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:14.608 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid.h usability... no 2023-11-19T00:40:14.630 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid.h presence... no 2023-11-19T00:40:14.630 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid.h... no 2023-11-19T00:40:14.677 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid/uuid.h usability... yes 2023-11-19T00:40:14.679 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:14.678+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:14.693 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid/uuid.h presence... yes 2023-11-19T00:40:14.693 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid/uuid.h... yes 2023-11-19T00:40:14.733 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.734 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.738 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/uuid.h usability... no 2023-11-19T00:40:14.742 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:14.747 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:14.761 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/uuid.h presence... no 2023-11-19T00:40:14.761 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/uuid.h... no 2023-11-19T00:40:14.780 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:14.779+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:14.802 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/file.h usability... yes 2023-11-19T00:40:14.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:40:14.817 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/file.h presence... yes 2023-11-19T00:40:14.817 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/file.h... yes 2023-11-19T00:40:14.854 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:14.854 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:14.864 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:14.880 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:14.880+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:14.886 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fcntl.h usability... yes 2023-11-19T00:40:14.898 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:14.898 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:14.902 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fcntl.h presence... yes 2023-11-19T00:40:14.902 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/fcntl.h... yes 2023-11-19T00:40:14.920 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:14.944 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:14.944 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/syssgi.h usability... no 2023-11-19T00:40:14.971 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:14.972 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:14.976 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/syssgi.h presence... no 2023-11-19T00:40:14.976 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/syssgi.h... no 2023-11-19T00:40:14.981 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:14.981 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:14.980+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:15.082 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:15.082+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:15.092 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/param.h usability... yes 2023-11-19T00:40:15.110 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/param.h presence... yes 2023-11-19T00:40:15.110 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/param.h... yes 2023-11-19T00:40:15.121 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/stat.h... (cached) yes 2023-11-19T00:40:15.130 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 100.498350891, 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 98.972538298000003, 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:15.143 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 98.972512907999999, 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:15.144 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:15.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:15.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 98.571737181000003, 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:15.150 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:15.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:15.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:15.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.360933837999994, 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.156 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:15.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.360443119999999, 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:15.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:15.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:15.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.360390496999997, 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:15.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:15.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:15.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:15.175 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358914048000003, 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:15.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:15.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:15.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358869788999996, 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:15.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358827384999998, 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:15.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:15.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:15.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:15.195 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358780543999998, 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:15.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:15.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358709297000004, 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.202 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:15.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:15.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358512860999994, 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:15.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:15.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358461109999993, 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:15.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:15.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.221 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358255661000001, 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:15.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:15.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.358204724999993, 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.357766342999994, 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.357729215000006, 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.357668430999993, 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 7.3030644039999997, 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:15.255 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:15.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:15.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:15.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:15.260 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:15.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:15.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/statvfs.h usability... yes 2023-11-19T00:40:15.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/statvfs.h presence... yes 2023-11-19T00:40:15.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/statvfs.h... yes 2023-11-19T00:40:15.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/time.h usability... yes 2023-11-19T00:40:15.264 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/time.h presence... yes 2023-11-19T00:40:15.264 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/time.h... yes 2023-11-19T00:40:15.264 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:15.261+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:15.278 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/ioctl.h usability... yes 2023-11-19T00:40:15.292 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/ioctl.h presence... yes 2023-11-19T00:40:15.292 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/ioctl.h... yes 2023-11-19T00:40:15.337 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/wait.h usability... yes 2023-11-19T00:40:15.353 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/wait.h presence... yes 2023-11-19T00:40:15.353 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/wait.h... yes 2023-11-19T00:40:15.362 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:15.361+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:15.364 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/types.h... (cached) yes 2023-11-19T00:40:15.370 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:6340 4.15 4.45536015 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-11-19T00:40:15.370 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:15.370320+0000", 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.2422000000000001e-05, 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7472999999999997e-05, 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "queued for pg", 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 6340 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:15.370320+0000", 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:15.370320+0000", 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:15.370321+0000", 2023-11-19T00:40:15.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7400000000000002e-07 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:15.370325+0000", 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9149999999999998e-06 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:15.370336+0000", 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.049e-05 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:15.370344+0000", 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0620000000000001e-06 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:15.370383+0000", 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9520000000000001e-05 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.374 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-19T00:40:15.375 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 1 2023-11-19T00:40:15.375 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:15.375 INFO:tasks.workunit.client.0.smithi046.stdout:checking for strings.h... (cached) yes 2023-11-19T00:40:15.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:15.417 INFO:tasks.workunit.client.0.smithi046.stdout:checking err.h usability... yes 2023-11-19T00:40:15.430 INFO:tasks.workunit.client.0.smithi046.stdout:checking err.h presence... yes 2023-11-19T00:40:15.431 INFO:tasks.workunit.client.0.smithi046.stdout:checking for err.h... yes 2023-11-19T00:40:15.464 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:15.463+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:15.473 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/falloc.h usability... yes 2023-11-19T00:40:15.484 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:15.485 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:15.486 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/falloc.h presence... yes 2023-11-19T00:40:15.486 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/falloc.h... yes 2023-11-19T00:40:15.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:15.531 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-11-19T00:40:15.553 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-11-19T00:40:15.553 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-19T00:40:15.564 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:15.563+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:15.593 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_itable.h usability... no 2023-11-19T00:40:15.602 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.603 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.820445693, 2023-11-19T00:40:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.604 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:15.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:15.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:15.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:15.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:15.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:15.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:15.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.617 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.815859027, 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.618 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:15.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:15.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:15.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.794673181, 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.627 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:15.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:15.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:15.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.634 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.76003686, 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.635 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:15.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:15.643 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.733960696, 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.699159193, 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.690950387000001, 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.690107812000001, 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.602640174999999, 2023-11-19T00:40:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.579711072, 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.567955181, 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:15.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.547337064000001, 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.545596010000001, 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.516007951000001, 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:15.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:15.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.491060818999999, 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.725 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:15.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:15.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.464545169000001, 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:15.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:15.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.447393304, 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:15.740 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:15.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.437297515000001, 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:15.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.4279367, 2023-11-19T00:40:15.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:15.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:15.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:15.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.762 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.414959245, 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:15.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:15.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:15.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:15.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:15.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:15.770 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:15.772 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:15.771+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:15.773 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_itable.h presence... no 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/platform_defs.h usability... no 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/platform_defs.h presence... no 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/platform_defs.h... no 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfs/ioctl.h usability... no 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfs/ioctl.h presence... no 2023-11-19T00:40:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:checking for btrfs/ioctl.h... no 2023-11-19T00:40:15.778 INFO:tasks.workunit.client.0.smithi046.stdout:checking cifs/ioctl.h usability... no 2023-11-19T00:40:15.800 INFO:tasks.workunit.client.0.smithi046.stdout:checking cifs/ioctl.h presence... no 2023-11-19T00:40:15.800 INFO:tasks.workunit.client.0.smithi046.stdout:checking for cifs/ioctl.h... no 2023-11-19T00:40:15.804 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:40:15.842 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/mman.h usability... yes 2023-11-19T00:40:15.856 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/mman.h presence... yes 2023-11-19T00:40:15.857 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/mman.h... yes 2023-11-19T00:40:15.872 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:15.872+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:15.882 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:15.882 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:15.882 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:15.883 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:15.887 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/xfs_log_format.h... no 2023-11-19T00:40:15.891 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid_compare... no 2023-11-19T00:40:15.974 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:15.974+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:15.991 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid_compare in -luuid... yes 2023-11-19T00:40:16.036 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:16.036 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:16.037 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:16.037 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:16.037 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:16.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:16.055 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/xfs.h... yes 2023-11-19T00:40:16.080 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/libxfs.h... no 2023-11-19T00:40:16.089 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:16.088+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:16.107 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-19T00:40:16.146 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/xqm.h... yes 2023-11-19T00:40:16.152 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.099555927000001, 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.153 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:16.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:16.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.159 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.343881739, 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.160 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:16.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:16.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.168 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.281417962999999, 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.169 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:16.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:16.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:16.178 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.180838614000001, 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:16.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:16.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:16.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:16.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.015527835, 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.189 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:16.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.000008684999999, 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.197 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:16.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:16.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.934217595, 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.205 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:16.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:16.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.754343910999999, 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.213 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:16.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:16.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:16.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.681239254999999, 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:16.220 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:16.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:16.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.629542095, 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:16.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:16.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:16.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:16.234 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.595151116, 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.235 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:16.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:16.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:16.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.242 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.58470691, 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.563849839, 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:16.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:16.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.402048647000001, 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.259 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:16.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:16.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.7938831690000008, 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:16.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:16.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.1465189299999992, 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3324144639999993, 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:16.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:16.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:228 4.8 4:11cbfb37:::1000000065c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:16.284 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3259707689999995, 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013114463999999999, 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824621+0000", 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1099999999999995e-07 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824636+0000", 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4899000000000001e-05 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824644+0000", 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4209999999999995e-06 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824652+0000", 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8809999999999996e-06 2023-11-19T00:40:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825206+0000", 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055371499999999998 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825362+0000", 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156169 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825472+0000", 2023-11-19T00:40:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110188 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827381+0000", 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001908365 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837644+0000", 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010263627000000001 2023-11-19T00:40:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837701+0000", 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6560000000000001e-05 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837735+0000", 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3927999999999998e-05 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:257 4.2 4:40f27d78:::10000000546.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3253514590000002, 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012604687, 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8299999999999998e-07 2023-11-19T00:40:16.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825241+0000", 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4139999999999999e-06 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825248+0000", 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3090000000000001e-06 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825252+0000", 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7419999999999997e-06 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826682+0000", 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00142939 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826787+0000", 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105624 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826884+0000", 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6658999999999997e-05 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827750+0000", 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086578700000000002 2023-11-19T00:40:16.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837768+0000", 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010018144999999999 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837819+0000", 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0849000000000001e-05 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837844+0000", 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5485000000000001e-05 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:268 4.22 4:451df306:::10000000551.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.3253110209999992, 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012664776000000001, 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:16.297 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.27e-07 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825283+0000", 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1350000000000001e-06 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:16.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825289+0000", 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9460000000000003e-06 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825295+0000", 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1719999999999998e-06 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827106+0000", 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018117020000000001 2023-11-19T00:40:16.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827242+0000", 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000135582 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827325+0000", 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3222999999999999e-05 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:16.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.828145+0000", 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081991900000000001 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837875+0000", 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097303579999999997 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837917+0000", 2023-11-19T00:40:16.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1538000000000001e-05 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837945+0000", 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7874000000000001e-05 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:16.303 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:16.305 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:16.304+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:16.306 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:16.306 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-19T00:40:16.306 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/handle.h usability... yes 2023-11-19T00:40:16.307 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/handle.h presence... yes 2023-11-19T00:40:16.307 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/handle.h... yes 2023-11-19T00:40:16.310 INFO:tasks.workunit.client.0.smithi046.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-19T00:40:16.367 INFO:tasks.workunit.client.0.smithi046.stdout:checking attr/attributes.h usability... yes 2023-11-19T00:40:16.381 INFO:tasks.workunit.client.0.smithi046.stdout:checking attr/attributes.h presence... yes 2023-11-19T00:40:16.381 INFO:tasks.workunit.client.0.smithi046.stdout:checking for attr/attributes.h... yes 2023-11-19T00:40:16.405 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:16.405+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:16.412 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:16.412 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:16.412 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:16.412 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:16.421 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:16.426 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/attributes.h usability... no 2023-11-19T00:40:16.448 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/attributes.h presence... no 2023-11-19T00:40:16.448 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/attributes.h... no 2023-11-19T00:40:16.497 INFO:tasks.workunit.client.0.smithi046.stdout:checking for attr_list in -lattr... yes 2023-11-19T00:40:16.507 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:16.506+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:16.527 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:16.527 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:16.527 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:16.527 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:16.527 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:16.536 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:16.546 INFO:tasks.workunit.client.0.smithi046.stdout:checking for attr_set in -lattr... yes 2023-11-19T00:40:16.587 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/acl.h usability... yes 2023-11-19T00:40:16.602 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/acl.h presence... yes 2023-11-19T00:40:16.602 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/acl.h... yes 2023-11-19T00:40:16.607 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:16.607+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:16.636 INFO:tasks.workunit.client.0.smithi046.stdout:checking acl/libacl.h usability... yes 2023-11-19T00:40:16.645 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:16.645 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:16.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:16.645 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:16.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.645 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 102.013416256, 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:16.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:16.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:16.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.652 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 100.487603663, 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:16.653 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:16.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:16.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:16.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:16.659 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 100.487578273, 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:16.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:16.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:16.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:16.667 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 100.086802546, 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:16.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:16.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.875999203000006, 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:16.674 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:16.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:16.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:16.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.681 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.875508484999997, 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:16.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:16.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.875455861999995, 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:16.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:16.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:16.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873979413000001, 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:16.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:16.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873935153999994, 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:16.703 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:16.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:16.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:16.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.710 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873892749999996, 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:16.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:16.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873845908999996, 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:16.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:16.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:16.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:16.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:16.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873774662000002, 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:16.725 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:16.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:16.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.732 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873578226000006, 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:16.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:16.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873526475000006, 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:16.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:16.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.746 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873321025999999, 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.873270090000005, 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.872831708000007, 2023-11-19T00:40:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:16.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.872794580000004, 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.872733796000006, 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:16.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:16.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.781 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.8181297690000005, 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:16.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:16.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.786 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:16.787 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:16.787 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:16.789 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:16.787+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:16.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:16.790 INFO:tasks.workunit.client.0.smithi046.stdout:checking acl/libacl.h presence... yes 2023-11-19T00:40:16.790 INFO:tasks.workunit.client.0.smithi046.stdout:checking for acl/libacl.h... yes 2023-11-19T00:40:16.791 INFO:tasks.workunit.client.0.smithi046.stdout:checking for acl_init in -lacl... yes 2023-11-19T00:40:16.791 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm-ndbm.h usability... no 2023-11-19T00:40:16.791 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm-ndbm.h presence... no 2023-11-19T00:40:16.791 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gdbm-ndbm.h... no 2023-11-19T00:40:16.792 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm/ndbm.h usability... no 2023-11-19T00:40:16.814 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm/ndbm.h presence... no 2023-11-19T00:40:16.814 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gdbm/ndbm.h... no 2023-11-19T00:40:16.850 INFO:tasks.workunit.client.0.smithi046.stdout:checking ndbm.h usability... no 2023-11-19T00:40:16.872 INFO:tasks.workunit.client.0.smithi046.stdout:checking ndbm.h presence... no 2023-11-19T00:40:16.872 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ndbm.h... no 2023-11-19T00:40:16.888 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:16.888+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:16.903 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:16.904 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:16.904 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:16.904 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:16.904 INFO:tasks.workunit.client.0.smithi046.stdout:checking libaio.h usability... yes 2023-11-19T00:40:16.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:16.920 INFO:tasks.workunit.client.0.smithi046.stdout:checking libaio.h presence... yes 2023-11-19T00:40:16.920 INFO:tasks.workunit.client.0.smithi046.stdout:checking for libaio.h... yes 2023-11-19T00:40:16.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:40:16.961 INFO:tasks.workunit.client.0.smithi046.stdout:checking for dm_make_handle in -ldm... no 2023-11-19T00:40:16.962 INFO:tasks.workunit.client.0.smithi046.stdout: 2023-11-19T00:40:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:WARNING: could not find a valid DMAPI base library. 2023-11-19T00:40:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:If you want DMAPI support please install the data migration 2023-11-19T00:40:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:API (dmapi) library package. Alternatively, run "make install" 2023-11-19T00:40:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:from the dmapi source. 2023-11-19T00:40:16.962 INFO:tasks.workunit.client.0.smithi046.stdout: 2023-11-19T00:40:16.989 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:16.989+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:16.994 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fiemap.h usability... yes 2023-11-19T00:40:17.009 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fiemap.h presence... yes 2023-11-19T00:40:17.009 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/fiemap.h... yes 2023-11-19T00:40:17.021 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:17.021 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:17.022 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:17.022 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:17.022 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:17.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:17.060 INFO:tasks.workunit.client.0.smithi046.stdout:checking for fallocate... yes 2023-11-19T00:40:17.091 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:17.090+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:17.092 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:17.093 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:17.112 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:17.112 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:17.121 INFO:tasks.workunit.client.0.smithi046.stdout:checking for open_by_handle_at... yes 2023-11-19T00:40:17.131 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:17.131 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:17.135 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:17.135 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:17.144 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:17.187 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/prctl.h usability... yes 2023-11-19T00:40:17.191 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:17.191+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:17.201 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/prctl.h presence... yes 2023-11-19T00:40:17.201 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/prctl.h... yes 2023-11-19T00:40:17.235 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fs.h usability... yes 2023-11-19T00:40:17.248 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fs.h presence... yes 2023-11-19T00:40:17.248 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/fs.h... yes 2023-11-19T00:40:17.251 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:17.251 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:17.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:17.284 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfsutil.h usability... no 2023-11-19T00:40:17.302 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:17.301+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:17.306 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfsutil.h presence... no 2023-11-19T00:40:17.306 INFO:tasks.workunit.client.0.smithi046.stdout:checking for btrfsutil.h... no 2023-11-19T00:40:17.357 INFO:tasks.workunit.client.0.smithi046.stdout:checking for copy_file_range... yes 2023-11-19T00:40:17.393 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:17.392+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:17.405 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:17.405 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:17.410 INFO:tasks.workunit.client.0.smithi046.stdout:checking for renameat2... yes 2023-11-19T00:40:17.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:17.429 INFO:tasks.workunit.client.0.smithi046.stdout:configure: creating ./config.status 2023-11-19T00:40:17.498 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:17.497+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:17.559 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:17.559 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:17.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:17.595 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:17.595+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:17.676 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:17.676 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:17.685 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:17.696 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:17.695+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:17.783 INFO:tasks.workunit.client.0.smithi046.stdout:config.status: creating include/builddefs 2023-11-19T00:40:17.790 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:17.790 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:17.797 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:17.796+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:17.799 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:17.799 INFO:tasks.workunit.client.0.smithi046.stdout:config.status: creating include/config.h 2023-11-19T00:40:17.809 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:40:17.809 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:40:17.809 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.41845744695386855 2023-11-19T00:40:17.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.41845744695386855 2023-11-19T00:40:17.813 INFO:tasks.workunit.client.0.smithi046.stdout:config.status: executing libtool commands 2023-11-19T00:40:17.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:40:17.898 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:17.898+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:17.935 INFO:tasks.workunit.client.0.smithi046.stdout:Building include 2023-11-19T00:40:17.935 INFO:tasks.workunit.client.0.smithi046.stdout:Building lib 2023-11-19T00:40:17.936 INFO:tasks.workunit.client.0.smithi046.stdout:Building tests 2023-11-19T00:40:17.943 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:17.943 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:17.952 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:17.953 INFO:tasks.workunit.client.0.smithi046.stdout: [LTDEP] 2023-11-19T00:40:17.999 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:17.998+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:18.057 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.057 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:18.101 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:18.100+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:18.201 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:18.200+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:18.211 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.211 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:18.271 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dataascii.lo 2023-11-19T00:40:18.272 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] databin.lo 2023-11-19T00:40:18.272 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] datapid.lo 2023-11-19T00:40:18.272 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] file_lock.lo 2023-11-19T00:40:18.302 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:18.301+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:18.324 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.324 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:18.403 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:18.402+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:18.439 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] forker.lo 2023-11-19T00:40:18.443 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.443 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:18.453 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] pattern.lo 2023-11-19T00:40:18.503 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:18.503+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:18.511 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] open_flags.lo 2023-11-19T00:40:18.519 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] random_range.lo 2023-11-19T00:40:18.558 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.558 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:18.610 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:18.610+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:18.626 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] string_to_tokens.lo 2023-11-19T00:40:18.648 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] str_to_bytes.lo 2023-11-19T00:40:18.672 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.673 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.681 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:18.724 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:18.724+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:18.731 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] tlibio.lo 2023-11-19T00:40:18.784 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] write_log.lo 2023-11-19T00:40:18.789 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.789 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.798 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.1 to 0.418457 (6b20) 2023-11-19T00:40:18.818 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:40:18.840 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:18.839+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:18.844 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] random.lo 2023-11-19T00:40:18.909 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:18.908+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:18.946 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:18.946 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:18.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:19.009 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:19.009+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:19.101 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:19.101 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:19.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:19.110 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:19.111+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:19.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:19.211 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:19.211+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:19.215 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:19.215 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:19.224 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:19.273 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:19.273 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:19.291 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:19.309 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:19.309 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:19.312 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:19.312+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:19.328 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:19.329 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:19.329 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:19.329 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:19.329 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:19.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:19.412 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:19.412+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:19.445 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.663619144999998, 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.659032479, 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.637846632999999, 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.603210312000002, 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.577134147999999, 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:19.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.542332644999998, 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.485 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:19.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:19.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:19.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.534123838999999, 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.492 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:19.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.499 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.533281263999999, 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.500 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:19.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:19.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.445813627, 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.508 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:19.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:19.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:19.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:19.515 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.422884524000001, 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:19.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:19.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:19.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.522 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.411128633000001, 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:19.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:19.530 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.390510515999999, 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:19.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:19.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:19.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:19.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:19.539 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.388769461999999, 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:19.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:19.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:19.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.546 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.359181403000001, 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:19.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:19.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:19.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.334234271, 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:19.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:19.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:19.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.307718620999999, 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:19.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:19.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.290566756, 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:19.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:19.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.280470966999999, 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.577 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:19.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:19.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.271110151999999, 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.584 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.258132697000001, 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:19.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:19.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:19.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:19.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:19.597 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:19.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:19.599 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:19.598+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:19.700 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:19.699+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:19.708 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:19.708 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:19.717 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:19.800 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:19.799+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:19.821 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:19.821 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:19.821 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:19.821 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:19.821 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:19.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:19.919 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:19.918+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.928003021999999, 2023-11-19T00:40:19.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:19.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:19.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:19.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.172328833999998, 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:19.988 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:19.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:19.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.995 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.109865058, 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:19.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:19.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:19.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:20.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:20.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.009285709, 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.003 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:20.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:20.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:20.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.010 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.843974930000002, 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:20.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:20.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.828455779999999, 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.018 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:20.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.025 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.762664690000001, 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:20.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:20.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:20.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.582791006000001, 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.033 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:20.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:20.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:20.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:20.040 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.509686349999999, 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:20.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:20.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:20.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:20.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.457989189999999, 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:20.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:20.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.423598211000002, 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.056 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:20.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.413154004999999, 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:20.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:20.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:20.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:20.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.070 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.392296934000001, 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:20.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:20.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:20.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.230495741999999, 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:20.078 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:20.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:20.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:20.085 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.622330264, 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:20.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:20.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.974966025000001, 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:20.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.160861559000001, 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:20.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:20.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:228 4.8 4:11cbfb37:::1000000065c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.154417863999999, 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013114463999999999, 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824620+0000", 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824621+0000", 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1099999999999995e-07 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824636+0000", 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4899000000000001e-05 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824644+0000", 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4209999999999995e-06 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824652+0000", 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8809999999999996e-06 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825206+0000", 2023-11-19T00:40:20.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055371499999999998 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825362+0000", 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156169 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825472+0000", 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110188 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827381+0000", 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001908365 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837644+0000", 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010263627000000001 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837701+0000", 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6560000000000001e-05 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837735+0000", 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3927999999999998e-05 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.109 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:257 4.2 4:40f27d78:::10000000546.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.153798554, 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012604687, 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825240+0000", 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8299999999999998e-07 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825241+0000", 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4139999999999999e-06 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825248+0000", 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3090000000000001e-06 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825252+0000", 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7419999999999997e-06 2023-11-19T00:40:20.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826682+0000", 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00142939 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826787+0000", 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105624 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.826884+0000", 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6658999999999997e-05 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827750+0000", 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086578700000000002 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837768+0000", 2023-11-19T00:40:20.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010018144999999999 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837819+0000", 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0849000000000001e-05 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837844+0000", 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5485000000000001e-05 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.115 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:268 4.22 4:451df306:::10000000551.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.153758116000001, 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012664776000000001, 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:20.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825280+0000", 2023-11-19T00:40:20.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.27e-07 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825283+0000", 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1350000000000001e-06 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825289+0000", 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9460000000000003e-06 2023-11-19T00:40:20.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.825295+0000", 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1719999999999998e-06 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827106+0000", 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018117020000000001 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:20.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827242+0000", 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000135582 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.827325+0000", 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3222999999999999e-05 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.828145+0000", 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081991900000000001 2023-11-19T00:40:20.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837875+0000", 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097303579999999997 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837917+0000", 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1538000000000001e-05 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:20.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.837945+0000", 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7874000000000001e-05 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:20.122 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:20.124 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:20.124 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:20.123+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:20.224 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:20.223+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:20.230 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:20.230 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:20.239 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:20.325 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:20.324+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:20.383 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:20.383 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:20.391 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:20.426 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:20.426+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:20.498 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.8664909, 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:20.499 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:20.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:20.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.340678307, 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.506 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:20.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:20.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:20.512 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.340652917, 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.93987719, 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.519 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:20.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:20.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:20.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.729073846999995, 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:20.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:20.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:20.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.532 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.728583129, 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.728530505999998, 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.727054057000004, 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.727009797999997, 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:20.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:20.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.726967393999999, 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:20.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:20.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:20.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:20.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:20.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:20.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:20.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:20.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:20.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.726920552999999, 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.571 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:20.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.578 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.726849306000005, 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:20.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:20.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.726652869999995, 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:20.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.726601118999994, 2023-11-19T00:40:20.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:20.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:20.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:20.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.726395670000002, 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:20.599 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:20.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:20.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.726344733999994, 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:20.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.612 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.725906351999996, 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:20.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:20.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:20.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:20.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.725869223999993, 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:20.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:20.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:20.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.725808439999994, 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 12.671204413, 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:20.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:20.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:20.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:20.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:20.637 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:20.638 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:20.637+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:20.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:20.738 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:20.738+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:20.755 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:20.756 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:20.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:20.839 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:20.839+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:20.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:40:20.936 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:20.936 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:20.936 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:20.936 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:20.937 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:20.940 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:20.939+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:20.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:20.977 INFO:tasks.workunit.client.0.smithi046.stdout: [LD] 2023-11-19T00:40:21.040 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:21.039+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:21.059 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:21.059 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:21.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:21.059 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:21.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.059 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.059 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.276730553, 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:21.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:21.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.272143886999999, 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:21.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:21.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.250958041000001, 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.075 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:21.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.076 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:21.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:21.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:21.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.21632172, 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.084 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:21.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:21.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:21.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:21.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:21.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:21.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.190245556000001, 2023-11-19T00:40:21.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:21.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.155444053, 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:21.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:21.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:21.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:21.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.107 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.147235247000001, 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:21.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:21.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:21.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.115 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.146392672000001, 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.116 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:21.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:21.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.058925035000001, 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:21.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:21.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.035995931999999, 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:21.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:21.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.138 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.024240040999999, 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.139 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:21.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:21.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:21.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.003621924000001, 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:21.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:21.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:21.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.153 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.001880870000001, 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:21.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:21.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:21.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.972292810999999, 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:21.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:21.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:21.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:21.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.169 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.947345679000001, 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.170 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.173 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:21.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.173 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:21.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:21.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:21.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:21.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:21.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.182 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.920830029000001, 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:21.183 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.184 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.184 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.184 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.184 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.184 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:21.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.185 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:21.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:21.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:21.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:21.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:21.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:21.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:21.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:21.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:21.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:21.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:21.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:21.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:21.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:21.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.903678163999999, 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:21.198 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:21.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:21.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.893582375000001, 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:21.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:21.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:21.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:21.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:21.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:21.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.88422156, 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:21.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:21.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:21.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.871244104999999, 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:21.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:21.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:21.231 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:21.232 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:21.233 INFO:tasks.workunit.client.0.smithi046.stdout:Building ltp 2023-11-19T00:40:21.234 INFO:tasks.workunit.client.0.smithi046.stdout:Building src 2023-11-19T00:40:21.234 INFO:tasks.workunit.client.0.smithi046.stdout:Building m4 2023-11-19T00:40:21.234 INFO:tasks.workunit.client.0.smithi046.stdout:Building common 2023-11-19T00:40:21.234 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2023-11-19T00:40:21.234 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2023-11-19T00:40:21.234 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:21.235 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:21.232+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:21.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:40:21.334 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:21.333+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:21.340 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:21.340 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:21.340 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:21.340 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:21.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:21.434 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:21.434+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:21.453 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:21.453 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:21.454 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:21.454 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:21.454 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:21.462 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:21.468 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:21.489 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:21.489 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:21.511 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:21.511 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:21.535 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:21.535+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:21.606 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:21.606 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:21.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:21.654 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] doio 2023-11-19T00:40:21.654 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fsstress 2023-11-19T00:40:21.654 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fsx 2023-11-19T00:40:21.658 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:21.658+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:21.735 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:21.735 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:21.737 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:21.737+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:21.745 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:21.826 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:40:21.839 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:21.838+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:21.900 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:21.901 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:21.910 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:21.939 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c: In function 'attr_list_path': 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~ 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr:In file included from ../src/global.h:25, 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr: from fsstress.c:12: 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~ 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c: In function 'attr_remove_path': 2023-11-19T00:40:21.940 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~ 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr:In file included from ../src/global.h:25, 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr: from fsstress.c:12: 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~ 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c: In function 'attr_set_path': 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~ 2023-11-19T00:40:21.941 INFO:tasks.workunit.client.0.smithi046.stderr:In file included from ../src/global.h:25, 2023-11-19T00:40:21.942 INFO:tasks.workunit.client.0.smithi046.stderr: from fsstress.c:12: 2023-11-19T00:40:21.942 INFO:tasks.workunit.client.0.smithi046.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2023-11-19T00:40:21.942 INFO:tasks.workunit.client.0.smithi046.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2023-11-19T00:40:21.942 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~ 2023-11-19T00:40:21.953 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:21.953+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:21.957 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c: In function 'allocsp_f': 2023-11-19T00:40:21.957 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2023-11-19T00:40:21.957 INFO:tasks.workunit.client.0.smithi046.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2023-11-19T00:40:21.958 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-19T00:40:21.958 INFO:tasks.workunit.client.0.smithi046.stderr: | XFS_IOC_RESVSP64 2023-11-19T00:40:21.958 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2023-11-19T00:40:21.982 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c: In function 'freesp_f': 2023-11-19T00:40:21.983 INFO:tasks.workunit.client.0.smithi046.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2023-11-19T00:40:21.983 INFO:tasks.workunit.client.0.smithi046.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2023-11-19T00:40:21.983 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-19T00:40:21.983 INFO:tasks.workunit.client.0.smithi046.stderr: | XFS_IOC_RESVSP64 2023-11-19T00:40:22.023 INFO:tasks.workunit.client.0.smithi046.stderr:gmake[3]: *** [Makefile:46: fsstress] Error 1 2023-11-19T00:40:22.023 INFO:tasks.workunit.client.0.smithi046.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2023-11-19T00:40:22.026 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.026 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.036 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:22.077 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:22.076+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:22.142 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:22.141+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:22.147 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.147 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:22.242 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:22.242+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:22.272 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.272 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:22.343 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:22.342+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr:doio.c: In function 'parse_cmdline': 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr: 3113 | fprintf(stderr, 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~~~~~ 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr: 3115 | Prog, TagName, tok); 2023-11-19T00:40:22.392 INFO:tasks.workunit.client.0.smithi046.stderr: | ~~~~~~~~~~~~~~~~~~~ 2023-11-19T00:40:22.400 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.400 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.410 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:22.417 INFO:tasks.workunit.client.0.smithi046.stderr:fsx.c: In function 'main': 2023-11-19T00:40:22.417 INFO:tasks.workunit.client.0.smithi046.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2023-11-19T00:40:22.417 INFO:tasks.workunit.client.0.smithi046.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2023-11-19T00:40:22.417 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-19T00:40:22.418 INFO:tasks.workunit.client.0.smithi046.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2023-11-19T00:40:22.418 INFO:tasks.workunit.client.0.smithi046.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2023-11-19T00:40:22.418 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-19T00:40:22.444 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:22.444+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:22.525 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.525 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.535 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:22.538 INFO:tasks.workunit.client.0.smithi046.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2023-11-19T00:40:22.538 INFO:tasks.workunit.client.0.smithi046.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2023-11-19T00:40:22.545 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:22.545+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:22.646 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:22.645+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:22.649 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.649 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:22.746 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:22.746+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:22.804 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.805 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.813 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:22.848 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:22.847+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:22.924 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:22.924 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:22.933 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:22.976 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:22.976+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:23.038 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:23.038 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:23.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:23.089 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:23.088+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:23.151 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:23.151+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:23.192 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:23.192 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:23.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:23.252 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:23.251+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:23.307 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:23.308 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:23.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:23.359 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:23.359+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:23.421 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:23.422 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:23.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:23.454 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:23.453+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:23.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:23.554 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:23.553+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:23.575 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:23.584 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:23.655 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:23.655+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:23.665 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:23.688 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:23.688 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:23.705 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:23.706 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:23.710 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:23.710 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:23.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:23.758 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:23.758+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:23.821 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:23.821 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:23.821 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:23.821 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:23.822 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:23.829 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:23.843 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:40:23.843 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:40:23.843 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-11-19T00:40:23.843 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2023-11-19T00:40:23.844 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2023-11-19T00:40:23.844 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:40:23.857 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:23.857+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:23.958 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:23.957+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:23.977 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.923602093, 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:23.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:23.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:23.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:23.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:23.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.167927904999999, 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:23.985 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:23.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:23.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:23.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:23.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.105464129000001, 2023-11-19T00:40:23.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:23.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:23.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:23.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:23.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.004884780000001, 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.000 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:24.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:24.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.839574000999999, 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:24.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:24.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.824054851, 2023-11-19T00:40:24.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:24.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:24.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.019 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.758263760999998, 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.020 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:24.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:24.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:24.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.578390077000002, 2023-11-19T00:40:24.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:24.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:24.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.034 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.505285421, 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:24.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.037 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:24.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.453588261, 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.042 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:24.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:24.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.419197281999999, 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:24.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:24.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.055 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.408753076, 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:24.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.387896005000002, 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:24.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:24.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:24.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:24.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.226094813, 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:24.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:24.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:24.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:24.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.617929334999999, 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:24.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:24.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:24.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.970565096000001, 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:24.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.087 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.156460630000002, 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:24.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:24.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3393 4.5 4:a3c557f2:::10000001b6d.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.155869461, 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0254170279999999, 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818770+0000", 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818795+0000", 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4555000000000001e-05 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818810+0000", 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5359e-05 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818821+0000", 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2023-11-19T00:40:24.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818886+0000", 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5424000000000002e-05 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818891+0000", 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6800000000000001e-06 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834587+0000", 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015695962000000001 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834597+0000", 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5580000000000006e-06 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839154+0000", 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0045572659999999 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839276+0000", 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121908 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839381+0000", 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0001053 2023-11-19T00:40:24.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840806+0000", 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424717 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840819+0000", 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2911999999999999e-05 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844062+0000", 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003242951 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844105+0000", 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3149000000000003e-05 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844185+0000", 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0037000000000006e-05 2023-11-19T00:40:24.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3434 4.5 4:a059f840:::10000001b44.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.1557905770000003, 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0269672240000001, 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:40:24.102 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818850+0000", 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3290000000000001e-06 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818855+0000", 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5940000000000001e-06 2023-11-19T00:40:24.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818861+0000", 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5770000000000001e-06 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818947+0000", 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6001999999999994e-05 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818953+0000", 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-06 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834620+0000", 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015667103000000002 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834628+0000", 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1709999999999996e-06 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839852+0000", 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0052246499999999 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839967+0000", 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114296 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845814+0000", 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058473659999999997 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3444 4.5 4:a216e078:::10000001b1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:24.108 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.155752691, 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0271058879999999, 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:24.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1699999999999999e-07 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818888+0000", 2023-11-19T00:40:24.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6010000000000002e-06 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818895+0000", 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4109999999999999e-06 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818900+0000", 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3569999999999997e-06 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818971+0000", 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0581999999999996e-05 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818974+0000", 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0479999999999999e-06 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834649+0000", 2023-11-19T00:40:24.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01567474 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834652+0000", 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.647e-06 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840261+0000", 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0056082340000001 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840365+0000", 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010438300000000001 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840468+0000", 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103427 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840963+0000", 2023-11-19T00:40:24.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049454399999999997 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.841179+0000", 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021634099999999999 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845862+0000", 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00468295 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845903+0000", 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0920000000000001e-05 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845990+0000", 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7286000000000004e-05 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:24.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:24.117 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:24.118 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:24.118 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:24.117+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:24.218 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:24.218+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:24.227 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:24.227 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:24.227 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:24.227 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:24.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:24.319 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:24.318+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:24.339 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:24.339 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:24.347 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:24.420 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:24.420+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 109.821764751, 2023-11-19T00:40:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:24.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.29595215800001, 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:24.463 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:24.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:24.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:24.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:24.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:24.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.295926768, 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:24.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:24.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 107.89515104100001, 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:24.477 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:24.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.684347697999996, 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:24.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:24.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.683856980000002, 2023-11-19T00:40:24.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:24.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:24.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:24.498 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.683804357, 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.682327908000005, 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.682283648999999, 2023-11-19T00:40:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.682241245, 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.682194404000001, 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.526 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:24.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:24.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:24.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.682123157000007, 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.533 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:24.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:24.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.681926720999996, 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.540 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:24.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.547 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.681874969999996, 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:24.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.554 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.681669521000003, 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:24.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:24.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:24.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.681618584999995, 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:24.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:24.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:24.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.681180202999997, 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:24.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:24.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.681143074999994, 2023-11-19T00:40:24.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:24.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:24.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.583 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.681082290999996, 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:24.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 16.626478263999999, 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.589 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:24.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:24.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:24.594 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.594 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.594 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.594 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:24.594 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:24.594 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:24.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:24.596 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:24.594+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:24.622 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.2 primary-affinity to 0 (802) 2023-11-19T00:40:24.623 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:40:24.696 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:24.696+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:24.716 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:24.716 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:24.716 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:24.716 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:24.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:24.738 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2023-11-19T00:40:24.739 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2023-11-19T00:40:24.742 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2023-11-19T00:40:24.797 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:24.797+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:24.830 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:24.830 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:24.830 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:24.830 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:24.830 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:24.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:24.898 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:24.898+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:24.985 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:24.985 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.203458008999998, 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.986 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:24.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:24.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:24.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:24.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.198871343, 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:24.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:24.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:24.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:24.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.177685496999999, 2023-11-19T00:40:25.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:25.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:25.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:25.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.143049176000002, 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:25.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:25.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:25.016 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.116973011999999, 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:25.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:25.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:25.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.082171508999998, 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.025 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:25.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:25.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:25.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.073962702999999, 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.073120127999999, 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:25.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.985652491, 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:25.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:25.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:25.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:25.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.962723388000001, 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:25.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:25.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:25.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.950967497000001, 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:25.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:25.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.930349379999999, 2023-11-19T00:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:25.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:25.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:25.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.928608325999999, 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:25.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:25.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:25.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2337 4.35 4:af7622ea:::10000000b40.00000000:head [write 0~358] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.899020267000001, 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69994557400000001, 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.092 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2337 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084471+0000", 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084472+0000", 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3e-07 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084476+0000", 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0470000000000004e-06 2023-11-19T00:40:25.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084486+0000", 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8600000000000005e-06 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084492+0000", 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.781e-06 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084541+0000", 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8137999999999999e-05 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.084547+0000", 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3339999999999998e-06 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779964+0000", 2023-11-19T00:40:25.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.69541716600000003 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780055+0000", 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0723999999999994e-05 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780187+0000", 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132528 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782096+0000", 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019085129999999999 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784383+0000", 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022875270000000001 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784402+0000", 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8850000000000001e-05 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784417+0000", 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4375999999999999e-05 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.099 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2366 4.35 4:ad1dd98c:::10000000b5d.00000000:head [write 0~1381] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.874073135, 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67505889299999999, 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2366 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109418+0000", 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109419+0000", 2023-11-19T00:40:25.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7400000000000003e-07 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109422+0000", 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109430+0000", 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109434+0000", 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5650000000000003e-06 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109491+0000", 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6836999999999998e-05 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.109503+0000", 2023-11-19T00:40:25.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1813e-05 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780516+0000", 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.67101253999999999 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780577+0000", 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1393e-05 2023-11-19T00:40:25.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780643+0000", 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6438000000000003e-05 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.782455+0000", 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018116670000000001 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784421+0000", 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00196569 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784451+0000", 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9964e-05 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784477+0000", 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6322999999999999e-05 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2397 4.35 4:aeea61b3:::10000000b7c.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.847557484999999, 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64858304, 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2397 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135934+0000", 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135935+0000", 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.92e-07 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135938+0000", 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6380000000000002e-06 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135949+0000", 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0370999999999999e-05 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135954+0000", 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.079e-06 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135990+0000", 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6587000000000001e-05 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.135996+0000", 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7780000000000004e-06 2023-11-19T00:40:25.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780866+0000", 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.64487008000000001 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780934+0000", 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7849999999999996e-05 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781004+0000", 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9906000000000005e-05 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784028+0000", 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00302432 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784481+0000", 2023-11-19T00:40:25.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00045291400000000001 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784502+0000", 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0488000000000001e-05 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784517+0000", 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5237e-05 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.114 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2417 4.30 4:0e99f65c:::10000000b90.00000000:head [write 0~25] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.830405620000001, 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.63066571500000002, 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.115 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2417 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153086+0000", 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0200000000000002e-07 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153089+0000", 2023-11-19T00:40:25.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.931e-06 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153096+0000", 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9870000000000002e-06 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153100+0000", 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2579999999999997e-06 2023-11-19T00:40:25.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153136+0000", 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5398999999999998e-05 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.153143+0000", 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8929999999999999e-06 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778540+0000", 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62539703300000005 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778606+0000", 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6345000000000003e-05 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6618000000000005e-05 2023-11-19T00:40:25.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780373+0000", 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001700195 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783683+0000", 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033103130000000001 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783722+0000", 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8801999999999999e-05 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783751+0000", 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9339000000000001e-05 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2429 4.30 4:0dee59da:::10000000b9c.00000000:head [write 0~50] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.820309830999999, 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.62066575199999996, 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2429 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.123 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163181+0000", 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163182+0000", 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4499999999999996e-07 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163186+0000", 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5279999999999999e-06 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163196+0000", 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0115999999999999e-05 2023-11-19T00:40:25.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163201+0000", 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7570000000000004e-06 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163272+0000", 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1650999999999996e-05 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.163279+0000", 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6950000000000003e-06 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778896+0000", 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.615616948 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779009+0000", 2023-11-19T00:40:25.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011335199999999999 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779131+0000", 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000122135 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780420+0000", 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001288754 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783758+0000", 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003338274 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783802+0000", 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3442000000000002e-05 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783847+0000", 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5355000000000002e-05 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2440 4.30 4:0ed063f7:::10000000ba7.00000000:head [write 0~625] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.810949015999999, 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.61142328800000001, 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2440 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172542+0000", 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172543+0000", 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.75e-07 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172546+0000", 2023-11-19T00:40:25.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7860000000000001e-06 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172551+0000", 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6890000000000001e-06 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172555+0000", 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8739999999999997e-06 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172587+0000", 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1930000000000001e-05 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.172593+0000", 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2090000000000002e-06 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779500+0000", 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.606906842 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779566+0000", 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5464999999999997e-05 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779637+0000", 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1469000000000003e-05 2023-11-19T00:40:25.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781453+0000", 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00181562 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783856+0000", 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024028259999999998 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783927+0000", 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1851e-05 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783966+0000", 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8152000000000003e-05 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2455 4.30 4:0ff9340b:::10000000bb6.00000000:head [write 0~112] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.797971561000001, 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59852649099999999, 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2455 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.138 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185520+0000", 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6000000000000003e-07 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185524+0000", 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5669999999999999e-06 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185532+0000", 2023-11-19T00:40:25.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2509999999999994e-06 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185537+0000", 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0860000000000001e-06 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185576+0000", 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8433999999999998e-05 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.185585+0000", 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9050000000000003e-06 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779865+0000", 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.59428078100000004 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779935+0000", 2023-11-19T00:40:25.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9684000000000006e-05 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780047+0000", 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011144700000000001 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001470542 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783977+0000", 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024601699999999998 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784023+0000", 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5593000000000002e-05 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:25.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784046+0000", 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3371e-05 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:25.145 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:25.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:25.147 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:25.146+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:25.248 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:25.247+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:25.260 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:25.260 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:25.260 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:25.260 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:25.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:25.349 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:25.348+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:25.373 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:25.373 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:25.374 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:25.382 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:25.450 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:25.449+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:25.529 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:25.529 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:25.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:25.529 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:25.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.476106570999999, 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.530 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:25.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:25.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:25.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.720432382999999, 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:25.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:25.547 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.657968607000001, 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:25.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:25.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:25.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:25.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:25.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:25.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.557389258000001, 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.557 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.392078478999998, 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.566 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.376559328999999, 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.310768239000002, 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.130894555000001, 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.057789898999999, 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.006092739, 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.971701759999998, 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.961257553999999, 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.940400483000001, 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.778599290999999, 2023-11-19T00:40:25.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:25.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.170433812999999, 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:25.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:25.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:25.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.523069574000001, 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:25.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:25.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:25.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:25.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:25.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.708965108000001, 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:25.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:25.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:25.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3393 4.5 4:a3c557f2:::10000001b6d.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:25.677 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.7083739390000003, 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0254170279999999, 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818770+0000", 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818795+0000", 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4555000000000001e-05 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818810+0000", 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5359e-05 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818821+0000", 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818886+0000", 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5424000000000002e-05 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2023-11-19T00:40:25.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818891+0000", 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6800000000000001e-06 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834587+0000", 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015695962000000001 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834597+0000", 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5580000000000006e-06 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839154+0000", 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0045572659999999 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839276+0000", 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121908 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839381+0000", 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0001053 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840806+0000", 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424717 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840819+0000", 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2911999999999999e-05 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844062+0000", 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003242951 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844105+0000", 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3149000000000003e-05 2023-11-19T00:40:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844185+0000", 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0037000000000006e-05 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.687 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3434 4.5 4:a059f840:::10000001b44.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.7082950549999998, 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0269672240000001, 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2023-11-19T00:40:25.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818850+0000", 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3290000000000001e-06 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818855+0000", 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5940000000000001e-06 2023-11-19T00:40:25.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818861+0000", 2023-11-19T00:40:25.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5770000000000001e-06 2023-11-19T00:40:25.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818947+0000", 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6001999999999994e-05 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818953+0000", 2023-11-19T00:40:25.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-06 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834620+0000", 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015667103000000002 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834628+0000", 2023-11-19T00:40:25.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1709999999999996e-06 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839852+0000", 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0052246499999999 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839967+0000", 2023-11-19T00:40:25.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114296 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845814+0000", 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058473659999999997 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3444 4.5 4:a216e078:::10000001b1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.7082571690000004, 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0271058879999999, 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:25.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:25.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1699999999999999e-07 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818888+0000", 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6010000000000002e-06 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818895+0000", 2023-11-19T00:40:25.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4109999999999999e-06 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818900+0000", 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3569999999999997e-06 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818971+0000", 2023-11-19T00:40:25.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0581999999999996e-05 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818974+0000", 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0479999999999999e-06 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834649+0000", 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01567474 2023-11-19T00:40:25.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834652+0000", 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.647e-06 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840261+0000", 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0056082340000001 2023-11-19T00:40:25.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840365+0000", 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010438300000000001 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840468+0000", 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103427 2023-11-19T00:40:25.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840963+0000", 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049454399999999997 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.841179+0000", 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021634099999999999 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845862+0000", 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00468295 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845903+0000", 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0920000000000001e-05 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:25.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845990+0000", 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7286000000000004e-05 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:25.706 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:25.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:25.709 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:25.707+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:25.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:40:25.730 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dirstress 2023-11-19T00:40:25.739 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fill 2023-11-19T00:40:25.739 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fill2 2023-11-19T00:40:25.744 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] getpagesize 2023-11-19T00:40:25.809 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:25.808+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:25.816 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:25.816 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:25.817 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:25.817 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:25.825 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:25.894 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:25.895 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:25.910 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:25.909+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:25.919 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:25.919 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:25.930 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:25.930 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:25.930 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:25.930 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:25.930 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:25.939 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:25.947 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:25.947 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:25.966 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] holes 2023-11-19T00:40:25.986 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] lstat64 2023-11-19T00:40:26.011 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:26.010+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:26.083 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.083 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:26.136 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:26.134+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:26.144 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] nametest 2023-11-19T00:40:26.153 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] permname 2023-11-19T00:40:26.207 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.208 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.212 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:26.210+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:26.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:26.232 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] randholes 2023-11-19T00:40:26.258 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] runas 2023-11-19T00:40:26.313 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:26.312+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:26.361 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.361 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:26.414 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:26.413+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:26.473 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.473 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.482 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:26.492 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] truncfile 2023-11-19T00:40:26.514 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:26.514+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:26.517 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] usemem 2023-11-19T00:40:26.533 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] mmapcat 2023-11-19T00:40:26.586 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] append_reader 2023-11-19T00:40:26.592 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.592 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:26.615 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:26.614+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:26.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:40:26.705 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.706 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:26.718 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:26.717+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:26.774 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] append_writer 2023-11-19T00:40:26.777 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dirperf 2023-11-19T00:40:26.800 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] metaperf 2023-11-19T00:40:26.818 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:26.818+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:26.822 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.822 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.832 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:26.844 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] devzero 2023-11-19T00:40:26.920 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:26.919+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:26.937 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:26.937 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:26.946 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:27.021 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:27.020+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:27.037 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] feature 2023-11-19T00:40:27.050 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.051 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.059 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:27.121 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:27.121+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:27.143 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] alloc 2023-11-19T00:40:27.145 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fault 2023-11-19T00:40:27.164 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.164 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:27.212 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fstest 2023-11-19T00:40:27.222 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:27.222+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:27.279 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.279 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:27.323 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:27.323+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr:alloc.c: In function 'main': 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr: 154 | bozo! 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~ 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr:alloc.c:154:5: error: expected ';' before '!' token 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr: 154 | bozo! 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr: | ^ 2023-11-19T00:40:27.355 INFO:tasks.workunit.client.0.smithi046.stderr: | ; 2023-11-19T00:40:27.356 INFO:tasks.workunit.client.0.smithi046.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2023-11-19T00:40:27.356 INFO:tasks.workunit.client.0.smithi046.stderr: 184 | rflag = 1; 2023-11-19T00:40:27.356 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~ 2023-11-19T00:40:27.356 INFO:tasks.workunit.client.0.smithi046.stderr: | nflag 2023-11-19T00:40:27.356 INFO:tasks.workunit.client.0.smithi046.stderr:alloc.c:320:5: error: expected ';' before '!' token 2023-11-19T00:40:27.357 INFO:tasks.workunit.client.0.smithi046.stderr: 320 | bozo! 2023-11-19T00:40:27.357 INFO:tasks.workunit.client.0.smithi046.stderr: | ^ 2023-11-19T00:40:27.357 INFO:tasks.workunit.client.0.smithi046.stderr: | ; 2023-11-19T00:40:27.357 INFO:tasks.workunit.client.0.smithi046.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2023-11-19T00:40:27.357 INFO:tasks.workunit.client.0.smithi046.stderr: 128 | struct flock64 f; 2023-11-19T00:40:27.357 INFO:tasks.workunit.client.0.smithi046.stderr: | ^ 2023-11-19T00:40:27.359 INFO:tasks.workunit.client.0.smithi046.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2023-11-19T00:40:27.360 INFO:tasks.workunit.client.0.smithi046.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2023-11-19T00:40:27.391 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.391 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr:fstest.c: In function 'run_child': 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~ 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~ 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-11-19T00:40:27.439 INFO:tasks.workunit.client.0.smithi046.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~ 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~ 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2023-11-19T00:40:27.440 INFO:tasks.workunit.client.0.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-19T00:40:27.444 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:27.443+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:27.506 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.506 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.515 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:27.521 INFO:tasks.workunit.client.0.smithi046.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2023-11-19T00:40:27.521 INFO:tasks.workunit.client.0.smithi046.stderr:make[1]: *** [Makefile:53: default] Error 2 2023-11-19T00:40:27.522 INFO:tasks.workunit.client.0.smithi046.stderr:make: *** [Makefile:51: default] Error 2 2023-11-19T00:40:27.522 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-19T00:40:27.523 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2023-11-19T00:40:27.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-19T00:40:27.526 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:27.525+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:27.625 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.625 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.626 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:27.625+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:27.631 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:40:27.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:27.727 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:27.726+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:27.737 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.737 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:27.779 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi046 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2023-11-19T00:40:27.845 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0b7a274d01b04373a1f27f2c14a0bb48 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi046 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2023-11-19T00:40:27.847 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-19T00:40:27.856 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-19T00:40:27.857 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:40:27.857 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-19T00:40:27.862 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:27.861+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:27.877 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:40:27.877 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-19T00:40:27.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:40:27.962 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:27.961+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:27.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:27.965 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:27.965 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:27.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:28.063 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:28.062+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:28.086 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:28.086 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:28.095 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:28.104 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:28.104 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:28.123 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:28.123 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:28.140 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:28.164 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:28.163+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:28.200 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:28.200 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:28.200 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:28.208 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:28.265 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:28.264+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:28.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:28.273 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":57,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:40:27.627648+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"error_message":"pool 1 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":0.41845703125,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:40:28.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-19T00:38:42.590087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-19T00:38:43.103062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}] 2023-11-19T00:40:28.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-19T00:40:28.315 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:28.315 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:28.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:28.316 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:28.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.316 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:28.316 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:28.316 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 113.683542597, 2023-11-19T00:40:28.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.317 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:28.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:28.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:28.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.327 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:28.328 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:28.328 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 112.157730004, 2023-11-19T00:40:28.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:28.328 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.328 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.328 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:28.328 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:28.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:28.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:28.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:28.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:28.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:28.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:28.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 112.157704614, 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.338 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:28.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:28.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:28.339 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:28.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.339 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:28.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:28.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:28.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:28.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:28.347 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 111.756928887, 2023-11-19T00:40:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:28.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:28.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:28.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:28.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.357 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54612554400001, 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.358 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.359 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:28.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:28.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:28.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:28.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:28.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:28.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:28.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:28.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.370 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.545634826, 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:28.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:28.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:28.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:28.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:28.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:28.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:28.381 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.545582203, 2023-11-19T00:40:28.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:28.382 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.382 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.382 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:28.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:28.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:28.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:28.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:28.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:28.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:28.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:28.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:28.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:28.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.392 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.393 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:28.393 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.544105754, 2023-11-19T00:40:28.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:28.393 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.394 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.394 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:28.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:28.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54406149499999, 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:28.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:28.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.419 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.544019091, 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:28.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:28.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:28.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:28.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:28.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:28.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:28.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:28.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:28.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:28.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:28.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:28.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:28.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:28.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54397225, 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.431 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.432 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:28.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:28.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:28.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:28.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:28.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:28.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:28.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:28.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:28.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:28.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:28.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:28.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.443 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.443 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.543901003, 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:28.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:28.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:28.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:28.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:28.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:28.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:28.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:28.454 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.454 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.454 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.454 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.454 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54370456700001, 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:28.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:28.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:28.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:28.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:28.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:28.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54365281600001, 2023-11-19T00:40:28.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:28.466 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.466 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.466 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:28.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:28.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:28.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:28.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:28.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:28.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:28.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:28.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:28.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:28.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:28.476 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.543447367, 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:28.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:28.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:28.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:28.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:28.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:28.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:28.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:28.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:28.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:28.487 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54339643100001, 2023-11-19T00:40:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:28.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:28.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:28.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:28.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:28.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:28.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:28.497 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.498 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.498 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.498 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.498 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:28.498 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54295804900001, 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:28.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:28.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:28.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:28.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:28.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:28.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:28.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.508 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.542920921, 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:28.509 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:28.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:28.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:28.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:28.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:28.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:28.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 103.54286013700001, 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:28.520 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:28.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:28.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:28.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:28.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:28.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 20.488256110000002, 2023-11-19T00:40:28.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:28.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:28.535 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:28.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:28.538 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:28.536+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:28.580 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-11-19T00:40:28.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-19T00:40:28.637 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:28.637+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:28.646 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:28.647 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:28.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:28.738 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:28.737+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:28.761 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:28.761 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:28.761 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:28.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:28.838 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:28.837+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:28.876 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:28.876 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.094342870999998, 2023-11-19T00:40:28.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.878 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:28.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:28.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:28.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:28.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:28.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:28.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:28.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:28.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.888 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.089756205, 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.889 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.890 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:28.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.890 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:28.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:28.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:28.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.900 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.068570358999999, 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.901 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:28.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.902 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:28.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:28.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:28.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:28.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:28.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:28.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.033934038000002, 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.912 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:28.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:28.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:28.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:28.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:28.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:28.923 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.007857873999999, 2023-11-19T00:40:28.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:28.924 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.924 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.924 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.924 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.924 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.924 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:28.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:28.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:28.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:28.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:28.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:28.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:28.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:28.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.934 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.935 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.935 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:28.935 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.973056370999998, 2023-11-19T00:40:28.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:28.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:28.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:28.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:28.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:28.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:28.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:28.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:28.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:28.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:28.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.964847564999999, 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:28.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:28.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:28.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:28.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:28.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:28.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:28.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.958 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:28.959 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.964004989999999, 2023-11-19T00:40:28.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:28.959 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.959 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.959 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.959 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:28.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:28.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:28.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:28.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:28.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.876537353, 2023-11-19T00:40:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:28.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:28.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:28.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:28.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:28.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:28.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:28.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:28.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:28.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:28.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.983 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.853608250000001, 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:28.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:28.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:28.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:28.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:28.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:28.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:28.995 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.841852359000001, 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:28.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:28.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:28.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:28.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:28.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:28.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:28.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:29.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:29.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:29.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:29.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:29.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:29.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:29.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:29.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.006 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.821234241999999, 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.007 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:29.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:29.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:29.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:29.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:29.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.018 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.819493187999999, 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:29.019 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:29.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:29.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:29.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:29.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:29.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3575 3.13 3:ceffbd45:::200.0000000a:head [write 2562256~139962 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.733217+0000", 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.1411595190000003, 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.95658131000000002, 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733217+0000", 2023-11-19T00:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733217+0000", 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733219+0000", 2023-11-19T00:40:29.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1210000000000001e-06 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733410+0000", 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019096200000000001 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733432+0000", 2023-11-19T00:40:29.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2129000000000001e-05 2023-11-19T00:40:29.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733442+0000", 2023-11-19T00:40:29.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0353000000000001e-05 2023-11-19T00:40:29.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733522+0000", 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0036000000000004e-05 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733535+0000", 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3023000000000001e-05 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685495+0000", 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.95195965900000001 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685599+0000", 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000103729 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685671+0000", 2023-11-19T00:40:29.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2199000000000004e-05 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688596+0000", 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029255330000000001 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689719+0000", 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011230470000000001 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689769+0000", 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9214e-05 2023-11-19T00:40:29.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689798+0000", 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9305000000000001e-05 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3576 3.13 3:ceffbd45:::200.0000000a:head [write 2702218~10666 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.745980+0000", 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.1283957749999995, 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.94394634700000002, 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.041 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.745980+0000", 2023-11-19T00:40:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.745980+0000", 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.745982+0000", 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3769999999999999e-06 2023-11-19T00:40:29.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746000+0000", 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8345000000000001e-05 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746015+0000", 2023-11-19T00:40:29.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4817000000000001e-05 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746023+0000", 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5769999999999996e-06 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746077+0000", 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4808000000000001e-05 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746085+0000", 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.055e-06 2023-11-19T00:40:29.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686377+0000", 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.940291828 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686422+0000", 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4771000000000002e-05 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686488+0000", 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5870999999999993e-05 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688602+0000", 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021144750000000002 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689862+0000", 2023-11-19T00:40:29.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001259507 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689898+0000", 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5683999999999999e-05 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689927+0000", 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9232000000000001e-05 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.051 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:6657 4.3a 4:5c50f65b:::10000001be7.00000000:head [write 0~76] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.797787+0000", 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0765894559999998, 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.89200668299999997, 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:29.052 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 6657 2023-11-19T00:40:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797787+0000", 2023-11-19T00:40:29.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797787+0000", 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797790+0000", 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8509999999999999e-06 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797803+0000", 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3054000000000001e-05 2023-11-19T00:40:29.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797831+0000", 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8694e-05 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797845+0000", 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.33e-05 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797930+0000", 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5082999999999998e-05 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797941+0000", 2023-11-19T00:40:29.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1287999999999999e-05 2023-11-19T00:40:29.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.684608+0000", 2023-11-19T00:40:29.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88666688299999996 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.684813+0000", 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020498099999999999 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685208+0000", 2023-11-19T00:40:29.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00039495399999999999 2023-11-19T00:40:29.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686062+0000", 2023-11-19T00:40:29.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00085440699999999995 2023-11-19T00:40:29.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689702+0000", 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003640108 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689756+0000", 2023-11-19T00:40:29.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3485e-05 2023-11-19T00:40:29.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689793+0000", 2023-11-19T00:40:29.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7595000000000002e-05 2023-11-19T00:40:29.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.062 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3577 3.13 3:ceffbd45:::200.0000000a:head [write 2712884~5175 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.800000+0000", 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0743758489999999, 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.89000994600000005, 2023-11-19T00:40:29.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.064 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.064 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800000+0000", 2023-11-19T00:40:29.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800000+0000", 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800002+0000", 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2759999999999999e-06 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800015+0000", 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3529e-05 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800030+0000", 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5203e-05 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800039+0000", 2023-11-19T00:40:29.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0589999999999992e-06 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800104+0000", 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4536999999999996e-05 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800115+0000", 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1331e-05 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686890+0000", 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88677472700000004 2023-11-19T00:40:29.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686941+0000", 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.147e-05 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687015+0000", 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3188000000000005e-05 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688606+0000", 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001590876 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689964+0000", 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013580160000000001 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689992+0000", 2023-11-19T00:40:29.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8228000000000001e-05 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690010+0000", 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8505999999999999e-05 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3578 3.13 3:ceffbd45:::200.0000000a:head [write 2718059~2088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.850248+0000", 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0241283780000003, 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83984525700000001, 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850248+0000", 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850248+0000", 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850250+0000", 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.193e-06 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850261+0000", 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0862e-05 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850281+0000", 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0415999999999999e-05 2023-11-19T00:40:29.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850291+0000", 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0139999999999999e-05 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850367+0000", 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5099999999999996e-05 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850379+0000", 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2856e-05 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687321+0000", 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83694129500000003 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687369+0000", 2023-11-19T00:40:29.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8359999999999998e-05 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687442+0000", 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2885000000000004e-05 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689343+0000", 2023-11-19T00:40:29.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001901217 2023-11-19T00:40:29.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690048+0000", 2023-11-19T00:40:29.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070510500000000003 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690075+0000", 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.656e-05 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690093+0000", 2023-11-19T00:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8267999999999999e-05 2023-11-19T00:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3580 3.13 3:ceffbd45:::200.0000000a:head [write 2720147~2766 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.850445+0000", 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0239308889999998, 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83973188899999995, 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850445+0000", 2023-11-19T00:40:29.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850445+0000", 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850446+0000", 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1100000000000002e-07 2023-11-19T00:40:29.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850449+0000", 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.309e-06 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850453+0000", 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0899999999999998e-06 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850456+0000", 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7709999999999998e-06 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850497+0000", 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1193999999999999e-05 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850505+0000", 2023-11-19T00:40:29.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1610000000000003e-06 2023-11-19T00:40:29.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687794+0000", 2023-11-19T00:40:29.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83728891000000005 2023-11-19T00:40:29.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687837+0000", 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2954000000000002e-05 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687909+0000", 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2230999999999993e-05 2023-11-19T00:40:29.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689347+0000", 2023-11-19T00:40:29.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014378660000000001 2023-11-19T00:40:29.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690123+0000", 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077553500000000005 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690150+0000", 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7668999999999999e-05 2023-11-19T00:40:29.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690177+0000", 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6888000000000001e-05 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.096 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3581 3.13 3:ceffbd45:::200.0000000a:head [write 2722913~1138 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:29.096 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:29.096 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0238892469999996, 2023-11-19T00:40:29.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83977273799999996, 2023-11-19T00:40:29.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:29.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:29.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:29.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:29.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:29.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:29.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2799999999999996e-07 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850491+0000", 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.196e-06 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850495+0000", 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1949999999999996e-06 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850498+0000", 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9000000000000002e-06 2023-11-19T00:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850532+0000", 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3853000000000003e-05 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850538+0000", 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688160+0000", 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.837621583 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688205+0000", 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4932000000000003e-05 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688293+0000", 2023-11-19T00:40:29.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8778999999999998e-05 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690207+0000", 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001913238 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:29.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690216+0000", 2023-11-19T00:40:29.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8069999999999994e-06 2023-11-19T00:40:29.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:29.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690242+0000", 2023-11-19T00:40:29.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5262999999999999e-05 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690260+0000", 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8050000000000002e-05 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:29.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:29.107 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:29.109 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-11-19T00:40:29.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:29.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-19T00:40:29.110 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:29.108+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:29.209 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:29.208+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:29.225 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:29.225 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:29.225 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:29.225 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:29.234 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:29.310 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:29.310+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:29.338 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:29.339 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:29.339 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:29.339 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:29.339 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:29.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:29.406 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-11-19T00:40:29.411 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:29.411+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:29.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-19T00:40:29.455 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:29.456 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:29.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:29.456 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:29.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.456 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:29.456 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.402720741, 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.457 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:29.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.458 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:29.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:29.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:29.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:29.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:29.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:29.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:29.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:29.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:29.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.647046552999999, 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:29.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:29.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:29.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:29.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:29.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:29.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:29.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:29.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:29.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:29.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:29.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:29.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:29.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.584582777000001, 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.481 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:29.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:29.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:29.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:29.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:29.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:29.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.492 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.492 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.484003428000001, 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.493 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:29.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.494 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:29.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:29.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:29.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:29.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:29.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:29.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:29.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.318692648999999, 2023-11-19T00:40:29.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.505 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:29.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:29.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:29.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:29.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:29.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:29.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:29.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:29.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:29.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:29.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.303173499, 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:29.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:29.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:29.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:29.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:29.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:29.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.527 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.237382408999999, 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.528 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:29.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:29.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:29.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:29.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:29.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:29.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:29.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:29.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:29.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:29.541 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.057508725000002, 2023-11-19T00:40:29.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:29.542 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.542 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:29.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:29.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:29.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:29.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:29.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:29.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:29.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.555 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.984404069, 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:29.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:29.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:29.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:29.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:29.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:29.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:29.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:29.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.932706909, 2023-11-19T00:40:29.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.568 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:29.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:29.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:29.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:29.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:29.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:29.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:29.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:29.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:29.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:29.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.578 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.898315929999999, 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:29.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:29.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:29.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:29.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:29.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:29.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:29.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:29.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:29.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:29.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:29.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:29.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:29.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.887871724, 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.593 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.593 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.593 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.593 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:29.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.593 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:29.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:29.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:29.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:29.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:29.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:29.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.867014652999998, 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:29.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:29.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:29.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:29.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.614 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.705213461, 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:29.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:29.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:29.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:29.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:29.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:29.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:29.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:29.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:29.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:29.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:29.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:29.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:29.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:29.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:29.627 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.097047983, 2023-11-19T00:40:29.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:29.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.628 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:29.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:29.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:29.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:29.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:29.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:29.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:29.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:29.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:29.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:29.636 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.449683744000001, 2023-11-19T00:40:29.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:29.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:29.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:29.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:29.644 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.635579278000002, 2023-11-19T00:40:29.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:29.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:29.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:29.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:29.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.655 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3393 4.5 4:a3c557f2:::10000001b6d.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.634988109, 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0254170279999999, 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:29.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818770+0000", 2023-11-19T00:40:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2023-11-19T00:40:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818795+0000", 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4555000000000001e-05 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818810+0000", 2023-11-19T00:40:29.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5359e-05 2023-11-19T00:40:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818821+0000", 2023-11-19T00:40:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2023-11-19T00:40:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818886+0000", 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5424000000000002e-05 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818891+0000", 2023-11-19T00:40:29.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6800000000000001e-06 2023-11-19T00:40:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834587+0000", 2023-11-19T00:40:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015695962000000001 2023-11-19T00:40:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834597+0000", 2023-11-19T00:40:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5580000000000006e-06 2023-11-19T00:40:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839154+0000", 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0045572659999999 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839276+0000", 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121908 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839381+0000", 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0001053 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840806+0000", 2023-11-19T00:40:29.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424717 2023-11-19T00:40:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840819+0000", 2023-11-19T00:40:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2911999999999999e-05 2023-11-19T00:40:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844062+0000", 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003242951 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844105+0000", 2023-11-19T00:40:29.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3149000000000003e-05 2023-11-19T00:40:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844185+0000", 2023-11-19T00:40:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0037000000000006e-05 2023-11-19T00:40:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3434 4.5 4:a059f840:::10000001b44.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.6349092249999995, 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0269672240000001, 2023-11-19T00:40:29.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:40:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818850+0000", 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3290000000000001e-06 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818855+0000", 2023-11-19T00:40:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5940000000000001e-06 2023-11-19T00:40:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818861+0000", 2023-11-19T00:40:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5770000000000001e-06 2023-11-19T00:40:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818947+0000", 2023-11-19T00:40:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6001999999999994e-05 2023-11-19T00:40:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818953+0000", 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-06 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834620+0000", 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015667103000000002 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834628+0000", 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1709999999999996e-06 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839852+0000", 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0052246499999999 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839967+0000", 2023-11-19T00:40:29.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114296 2023-11-19T00:40:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845814+0000", 2023-11-19T00:40:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058473659999999997 2023-11-19T00:40:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3444 4.5 4:a216e078:::10000001b1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.634871339, 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0271058879999999, 2023-11-19T00:40:29.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1699999999999999e-07 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818888+0000", 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6010000000000002e-06 2023-11-19T00:40:29.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818895+0000", 2023-11-19T00:40:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4109999999999999e-06 2023-11-19T00:40:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818900+0000", 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3569999999999997e-06 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818971+0000", 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0581999999999996e-05 2023-11-19T00:40:29.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818974+0000", 2023-11-19T00:40:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0479999999999999e-06 2023-11-19T00:40:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834649+0000", 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01567474 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834652+0000", 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.647e-06 2023-11-19T00:40:29.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840261+0000", 2023-11-19T00:40:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0056082340000001 2023-11-19T00:40:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840365+0000", 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010438300000000001 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840468+0000", 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103427 2023-11-19T00:40:29.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840963+0000", 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049454399999999997 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.841179+0000", 2023-11-19T00:40:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021634099999999999 2023-11-19T00:40:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845862+0000", 2023-11-19T00:40:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00468295 2023-11-19T00:40:29.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845903+0000", 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0920000000000001e-05 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:29.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845990+0000", 2023-11-19T00:40:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7286000000000004e-05 2023-11-19T00:40:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:29.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:29.692 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:29.693 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-11-19T00:40:29.693 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-11-19T00:40:29.693 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-11-19T00:40:29.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2023-11-19T00:40:29.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-11-19T00:40:29.696 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:29.696 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:29.693+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:29.718 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-11-19T00:40:29.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-19T00:40:29.794 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:29.794+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:29.809 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:29.809 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:29.810 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:29.810 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:29.818 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:29.895 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:29.894+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:29.925 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:29.925 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:29.925 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:29.925 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:29.925 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:29.934 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:29.996 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:29.995+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:30.039 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:30.040 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:30.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:30.040 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:30.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.040 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:30.040 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:30.040 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 115.407588109, 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:30.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.042 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:30.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:30.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:30.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:30.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:30.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:30.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:30.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:30.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:30.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:30.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:30.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:30.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:30.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:30.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:30.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:30.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:30.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:30.052 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 113.881775516, 2023-11-19T00:40:30.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:30.053 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.053 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.053 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:30.053 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:30.053 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:30.053 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:30.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.054 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.054 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:30.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:30.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:30.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:30.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:30.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:30.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:30.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.063 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:30.063 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:30.063 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 113.881750126, 2023-11-19T00:40:30.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:30.063 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.063 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:30.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:30.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:30.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:30.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:30.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:30.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:30.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:30.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:30.073 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 113.480974399, 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:30.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:30.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:30.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:30.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:30.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:30.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.084 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.084 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:30.084 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.270171056, 2023-11-19T00:40:30.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:30.084 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.084 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.084 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:30.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:30.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:30.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:30.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:30.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:30.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:30.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.094 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.269680338, 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:30.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:30.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:30.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:30.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:30.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:30.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:30.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.269627715, 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:30.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:30.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:30.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:30.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.116 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.268151266, 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:30.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:30.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:30.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:30.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:30.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:30.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.268107007, 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.268064603, 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.268017762, 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:30.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:30.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:30.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:30.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:30.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:30.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:30.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:30.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.26794651500001, 2023-11-19T00:40:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.161 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:30.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:30.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:30.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.171 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.267750079, 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:30.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:30.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:30.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:30.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.26769832799999, 2023-11-19T00:40:30.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:30.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:30.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.193 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.193 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:30.193 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.267492879, 2023-11-19T00:40:30.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:30.193 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.193 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:30.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:30.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:30.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:30.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.203 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.26744194299999, 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:30.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:30.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:30.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:30.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:30.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:30.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:30.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.267003561, 2023-11-19T00:40:30.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:30.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:30.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:30.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.26696643299999, 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:30.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:30.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:30.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:30.235 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.26690564899999, 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:30.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:30.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.243 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 22.212301621999998, 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:30.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:30.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:30.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:30.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:30.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:30.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:30.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:30.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:30.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.250 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:30.251 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:30.251 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:30.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-11-19T00:40:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-11-19T00:40:30.254 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:30.252+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:30.254 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-11-19T00:40:30.254 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-19T00:40:30.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:30.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:40:30.352 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:30.352+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:30.370 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:30.371 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:30.371 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:30.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:30.423 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:30.424 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:30.443 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:30.454 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:30.453+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:30.461 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:30.461 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:30.525 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:30.525 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:30.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:30.555 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:30.554+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:30.638 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:30.638 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:moved 18 / 210 (8.57143%) 2023-11-19T00:40:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:40:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 28.3901 -> 21.4009 (expected baseline 6.8313) 2023-11-19T00:40:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 30 -> 41 pgs (0.428571 -> 0.585714 * mean) 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.2 with 93 -> 93 pgs (1.32857 -> 1.32857 * mean) 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:oload 110 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 1 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0009 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0010 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 weight 0.4185 -> 0.5635 2023-11-19T00:40:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 weight 1.0000 -> 0.8495 2023-11-19T00:40:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2023-11-19T00:40:30.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:30.654 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":58,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:40:30.637220+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"error_message":"pool 1 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 average primary affinity is lower than 0.50, read balance score is not reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":0.849517822265625,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":0.5635223388671875,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:40:30.656 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:30.655+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:30.659 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2023-11-19T00:40:30.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2023-11-19T00:40:30.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-19T00:38:33.077694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-19T00:38:37.909259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-19T00:38:42.590087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-19T00:38:43.103062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}] 2023-11-19T00:40:30.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-19T00:40:30.757 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:30.756+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:30.765 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:30.765 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:30.775 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:30.858 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:30.858+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:30.879 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:30.879 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:30.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:30.958 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:30.958+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:30.971 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:40:30.970+0000 7f4b91e6e640 -1 mgr.server reply reply (2) No such file or directory no change 2023-11-19T00:40:30.972 INFO:teuthology.orchestra.run.smithi046.stdout:moved 26 / 210 (12.381%) 2023-11-19T00:40:30.972 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:40:30.972 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 21.4009 -> 16.7531 (expected baseline 6.8313) 2023-11-19T00:40:30.973 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 41 -> 61 pgs (0.585714 -> 0.871429 * mean) 2023-11-19T00:40:30.973 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.2 with 93 -> 89 pgs (1.32857 -> 1.27143 * mean) 2023-11-19T00:40:30.973 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:30.973 INFO:teuthology.orchestra.run.smithi046.stdout:oload 110 2023-11-19T00:40:30.973 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 3 2023-11-19T00:40:30.973 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:40:30.973 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0009 2023-11-19T00:40:30.974 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0010 2023-11-19T00:40:30.974 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 weight 0.5635 -> 0.7589 2023-11-19T00:40:30.974 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 weight 0.8495 -> 0.7217 2023-11-19T00:40:30.974 INFO:teuthology.orchestra.run.smithi046.stderr:no change 2023-11-19T00:40:30.986 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2023-11-19T00:40:30.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2023-11-19T00:40:30.993 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:30.993 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.002 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:31.015 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-11-19T00:40:31.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-19T00:40:31.059 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:31.059+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:31.112 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.112 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:31.161 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:31.160+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:31.262 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:31.261+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:31.266 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.266 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.275 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:31.314 INFO:tasks.ceph.mgr.x.smithi046.stderr:2023-11-19T00:40:31.313+0000 7f4b91e6e640 -1 mgr.server reply reply (2) No such file or directory no change 2023-11-19T00:40:31.315 INFO:teuthology.orchestra.run.smithi046.stdout:moved 13 / 210 (6.19048%) 2023-11-19T00:40:31.316 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:40:31.316 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 21.4009 -> 16.207 (expected baseline 6.8313) 2023-11-19T00:40:31.316 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 41 -> 52 pgs (0.585714 -> 0.742857 * mean) 2023-11-19T00:40:31.316 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.2 with 93 -> 90 pgs (1.32857 -> 1.28571 * mean) 2023-11-19T00:40:31.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:31.317 INFO:teuthology.orchestra.run.smithi046.stdout:oload 110 2023-11-19T00:40:31.317 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 0.05 2023-11-19T00:40:31.318 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:40:31.318 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0009 2023-11-19T00:40:31.318 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0010 2023-11-19T00:40:31.318 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 weight 0.5635 -> 0.6135 2023-11-19T00:40:31.318 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 weight 0.8495 -> 0.7995 2023-11-19T00:40:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:no change 2023-11-19T00:40:31.328 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-11-19T00:40:31.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2023-11-19T00:40:31.362 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:31.362+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:31.380 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.380 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.386 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-11-19T00:40:31.389 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:31.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-19T00:40:31.463 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:31.463+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:31.505 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.505 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.513 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:31.564 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:31.563+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:31.619 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.620 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:31.665 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:31.664+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:31.719 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-11-19T00:40:31.733 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-19T00:40:31.734 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.734 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:31.765 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:31.765+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:31.851 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.852 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.860 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:31.905 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:31.904+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:31.964 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:31.965 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:31.967 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:31.967+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:31.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:32.027 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-11-19T00:40:32.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-19T00:40:32.068 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:32.067+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:32.118 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:32.118 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:32.126 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:32.169 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:32.169+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:32.242 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:32.242 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:32.251 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:32.270 INFO:tasks.ceph.osd.1.smithi099.stderr:2023-11-19T00:40:32.270+0000 7f730f92d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 81359) UID: 0 2023-11-19T00:40:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-11-19T00:40:32.357 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:32.358 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:32.364 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2023-11-19T00:40:32.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:40:32.364 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-19T00:40:32.367 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:32.371 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:32.371+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:32.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[85811]: fuse finished with error 0 and tester_r 0 2023-11-19T00:40:32.402 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:40:32.473 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:32.471+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:32.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-11-19T00:40:32.483 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2023-11-19T00:40:32.483 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-11-19T00:40:32.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-11-19T00:40:32.503 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-11-19T00:40:32.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:40:32.503 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-19T00:40:32.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:40:32.558 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-11-19T00:40:32.572 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:32.572+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:32.604 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2023-11-19T00:40:32.605 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2023-11-19T00:40:32.609 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:32.610 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:32.610 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2023-11-19T00:40:32.610 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:32.614 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-19T00:40:32.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:40:32.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-19T00:40:32.618 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-11-19T00:40:32.626 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2023-11-19T00:40:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2023-11-19T00:40:32.643 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2023-11-19T00:40:32.643 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2023-11-19T00:40:32.648 INFO:teuthology.orchestra.run.smithi046.stdout:moved 26 / 210 (12.381%) 2023-11-19T00:40:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:40:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 21.4009 -> 16.7531 (expected baseline 6.8313) 2023-11-19T00:40:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.1 with 41 -> 61 pgs (0.585714 -> 0.871429 * mean) 2023-11-19T00:40:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.2 with 93 -> 89 pgs (1.32857 -> 1.27143 * mean) 2023-11-19T00:40:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:oload 110 2023-11-19T00:40:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 1 2023-11-19T00:40:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:40:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0009 2023-11-19T00:40:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0010 2023-11-19T00:40:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 weight 0.5635 -> 0.7580 2023-11-19T00:40:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 weight 0.8495 -> 0.7248 2023-11-19T00:40:32.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-11-19T00:40:32.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-19T00:40:32.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-11-19T00:40:32.667 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-11-19T00:40:32.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2023-11-19T00:40:32.706 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-19T00:40:32.705+0000 7fd05507c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 81243) UID: 0 2023-11-19T00:40:32.771 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:32.772 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2023-11-19T00:40:32.772 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2023-11-19T00:40:32.772 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2023-11-19T00:40:32.772 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:32.773 INFO:tasks.ceph.osd.2.smithi181.stderr:2023-11-19T00:40:32.773+0000 7f0239ca3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 81441) UID: 0 2023-11-19T00:40:32.780 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2023-11-19T00:40:32.789 INFO:tasks.thrashosds:joining thrashosds 2023-11-19T00:40:32.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-11-19T00:40:32.938 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-19T00:40:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2023-11-19T00:40:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2023-11-19T00:40:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2023-11-19T00:40:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1981 4.35 4:ac536b7e:::100000009dc.00000000:head [write 0~340] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.156578084, 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99850343200000002, 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1981 2023-11-19T00:40:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780033+0000", 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780035+0000", 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2023-11-19T00:40:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780041+0000", 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2609999999999999e-06 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780056+0000", 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5162e-05 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780065+0000", 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8079999999999994e-06 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780115+0000", 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0272000000000003e-05 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.780123+0000", 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.464e-06 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776055+0000", 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99593189800000004 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776130+0000", 2023-11-19T00:40:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5010000000000002e-05 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776215+0000", 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4782000000000002e-05 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777722+0000", 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001507038 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778494+0000", 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077206400000000004 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778519+0000", 2023-11-19T00:40:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5187000000000001e-05 2023-11-19T00:40:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778537+0000", 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7906000000000001e-05 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:1986 4.35 4:ac7c988a:::100000009e1.00000000:head [write 0~801] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.151991418000001, 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99403105400000003, 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1986 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784620+0000", 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784621+0000", 2023-11-19T00:40:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5499999999999997e-07 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784625+0000", 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5940000000000004e-06 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784638+0000", 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3064999999999999e-05 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784647+0000", 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3389999999999993e-06 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784693+0000", 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989999999999998e-05 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.784700+0000", 2023-11-19T00:40:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8680000000000001e-06 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776593+0000", 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99189322599999996 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776670+0000", 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7155000000000002e-05 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776738+0000", 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8343000000000006e-05 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778554+0000", 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001815767 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778583+0000", 2023-11-19T00:40:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9142999999999999e-05 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778622+0000", 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8735000000000001e-05 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8974000000000001e-05 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2010 4.35 4:acaad472:::100000009f9.00000000:head [write 0~2648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.130805572, 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97543190599999996, 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2010 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805806+0000", 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805807+0000", 2023-11-19T00:40:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3600000000000002e-07 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805814+0000", 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7989999999999994e-06 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805827+0000", 2023-11-19T00:40:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2886e-05 2023-11-19T00:40:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805836+0000", 2023-11-19T00:40:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3089999999999996e-06 2023-11-19T00:40:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805880+0000", 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4002999999999999e-05 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.805885+0000", 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5679999999999999e-06 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776966+0000", 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.97108123899999998 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777034+0000", 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7453999999999995e-05 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777108+0000", 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3585999999999996e-05 2023-11-19T00:40:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778683+0000", 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015759039999999999 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781195+0000", 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025116650000000002 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781219+0000", 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3787000000000001e-05 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8870000000000001e-05 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2050 4.30 4:0d0d1bdc:::10000000a21.00000000:head [write 0~905] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.096169250999999, 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93802934699999996, 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2050 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840442+0000", 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840443+0000", 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7299999999999995e-07 2023-11-19T00:40:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840447+0000", 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.676e-06 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840455+0000", 2023-11-19T00:40:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9190000000000005e-06 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840462+0000", 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1580000000000002e-06 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840509+0000", 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7890999999999999e-05 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.840518+0000", 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9970000000000004e-06 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776225+0000", 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.93570647100000004 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776347+0000", 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012167000000000001 2023-11-19T00:40:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.776476+0000", 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000129784 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778376+0000", 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018991380000000001 2023-11-19T00:40:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778392+0000", 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.662e-05 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778438+0000", 2023-11-19T00:40:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5643999999999999e-05 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778471+0000", 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3705999999999999e-05 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2080 4.30 4:0c817e9d:::10000000a3f.00000000:head [write 0~2110] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.070093087, 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.91400506500000001, 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2080 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866518+0000", 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866519+0000", 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4600000000000004e-07 2023-11-19T00:40:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866526+0000", 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6050000000000003e-06 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866534+0000", 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9840000000000001e-06 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866538+0000", 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6059999999999996e-06 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866591+0000", 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3161999999999997e-05 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.866602+0000", 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0930999999999999e-05 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777016+0000", 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.910413315 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777084+0000", 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8476e-05 2023-11-19T00:40:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777165+0000", 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0414000000000006e-05 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778495+0000", 2023-11-19T00:40:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001329986 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780437+0000", 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019422230000000001 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780499+0000", 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2129000000000001e-05 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.780523+0000", 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4488e-05 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2121 4.35 4:acfbb6e0:::10000000a68.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.035291583999999, 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88283604199999999, 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2121 2023-11-19T00:40:37.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.957 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:37.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:37.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:37.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:37.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:37.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901320+0000", 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9400000000000005e-07 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901324+0000", 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.749e-06 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901333+0000", 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4370000000000007e-06 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901339+0000", 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.942e-06 2023-11-19T00:40:37.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901383+0000", 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4598999999999998e-05 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.901393+0000", 2023-11-19T00:40:37.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7059999999999999e-06 2023-11-19T00:40:37.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:37.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777329+0000", 2023-11-19T00:40:37.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87593598100000003 2023-11-19T00:40:37.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777402+0000", 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3165999999999997e-05 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777471+0000", 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8538e-05 2023-11-19T00:40:37.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778720+0000", 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012497719999999999 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:37.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784084+0000", 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053633040000000002 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784125+0000", 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1465999999999999e-05 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784156+0000", 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0787999999999997e-05 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.966 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2131 4.35 4:adefed57:::10000000a72.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.027082778, 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87470075700000005, 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:37.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2131 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909529+0000", 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909530+0000", 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6500000000000008e-07 2023-11-19T00:40:37.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909535+0000", 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3689999999999998e-06 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:37.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909547+0000", 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2206e-05 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909555+0000", 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4000000000000003e-06 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909604+0000", 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9518999999999998e-05 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.909611+0000", 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2459999999999997e-06 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777747+0000", 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86813604200000005 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777812+0000", 2023-11-19T00:40:37.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4320999999999996e-05 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777875+0000", 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3532000000000001e-05 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779497+0000", 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016218300000000001 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784163+0000", 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046657649999999997 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784201+0000", 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8303999999999998e-05 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784229+0000", 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8257999999999999e-05 2023-11-19T00:40:37.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2132 4.30 4:0c647baa:::10000000a73.00000000:head [write 0~954] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.026240203, 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.87320640599999999, 2023-11-19T00:40:37.977 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2132 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:37.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910371+0000", 2023-11-19T00:40:37.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910372+0000", 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2200000000000004e-07 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:37.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910375+0000", 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.005e-06 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910381+0000", 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5350000000000001e-06 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910386+0000", 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1970000000000004e-06 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910428+0000", 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2005999999999997e-05 2023-11-19T00:40:37.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.910435+0000", 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9859999999999997e-06 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:37.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777469+0000", 2023-11-19T00:40:37.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.867033151 2023-11-19T00:40:37.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:37.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:37.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777587+0000", 2023-11-19T00:40:37.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118609 2023-11-19T00:40:37.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:37.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.777711+0000", 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012358900000000001 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779411+0000", 2023-11-19T00:40:38.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017006879999999999 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783500+0000", 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040887409999999999 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783546+0000", 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5277e-05 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783578+0000", 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2100000000000001e-05 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.014 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2236 4.35 4:ae5c0347:::10000000adb.00000000:head [write 0~1762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 30.938772566000001, 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78642922299999996, 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2236 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:38.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997839+0000", 2023-11-19T00:40:38.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997840+0000", 2023-11-19T00:40:38.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9500000000000002e-07 2023-11-19T00:40:38.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997845+0000", 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6529999999999999e-06 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997853+0000", 2023-11-19T00:40:38.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8779999999999998e-06 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997858+0000", 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7489999999999998e-06 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997922+0000", 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3761000000000002e-05 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:01.997933+0000", 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.172e-05 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778088+0000", 2023-11-19T00:40:38.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.78015469800000004 2023-11-19T00:40:38.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778166+0000", 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7558000000000005e-05 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778255+0000", 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9104000000000006e-05 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779546+0000", 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001291185 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784235+0000", 2023-11-19T00:40:38.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046890550000000001 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784254+0000", 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.916e-05 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784268+0000", 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4007e-05 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2263 4.35 4:ac65337a:::10000000af6.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.026 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 30.915843463000002, 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.76353661699999997, 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.027 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2263 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020768+0000", 2023-11-19T00:40:38.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020769+0000", 2023-11-19T00:40:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4300000000000002e-07 2023-11-19T00:40:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020773+0000", 2023-11-19T00:40:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8190000000000002e-06 2023-11-19T00:40:38.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020779+0000", 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5710000000000003e-06 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020785+0000", 2023-11-19T00:40:38.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2999999999999998e-06 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020822+0000", 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7008000000000002e-05 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.020829+0000", 2023-11-19T00:40:38.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.489e-06 2023-11-19T00:40:38.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778744+0000", 2023-11-19T00:40:38.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75791467700000004 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778821+0000", 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7724000000000003e-05 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778921+0000", 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9468000000000004e-05 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781188+0000", 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022671729999999999 2023-11-19T00:40:38.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784272+0000", 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030838100000000002 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784290+0000", 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8637000000000001e-05 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784305+0000", 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4198e-05 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.038 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2277 4.35 4:af5aad01:::10000000b04.00000000:head [write 0~158] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.038 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:38.038 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 30.904087572000002, 2023-11-19T00:40:38.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.75181918800000003, 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2277 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032524+0000", 2023-11-19T00:40:38.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032525+0000", 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2600000000000002e-07 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032531+0000", 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1260000000000003e-06 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032539+0000", 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1210000000000007e-06 2023-11-19T00:40:38.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032543+0000", 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5449999999999997e-06 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032582+0000", 2023-11-19T00:40:38.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8831999999999997e-05 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.032589+0000", 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9210000000000003e-06 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779141+0000", 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.74655218199999995 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779202+0000", 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1148999999999993e-05 2023-11-19T00:40:38.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779278+0000", 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5408999999999996e-05 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781272+0000", 2023-11-19T00:40:38.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019940159999999999 2023-11-19T00:40:38.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784308+0000", 2023-11-19T00:40:38.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030361339999999998 2023-11-19T00:40:38.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784327+0000", 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8692999999999999e-05 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784343+0000", 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2301 4.35 4:af501851:::10000000b1c.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.049 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 30.883469455, 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.73123781799999998, 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.050 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2301 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053142+0000", 2023-11-19T00:40:38.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053143+0000", 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053148+0000", 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1680000000000003e-06 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053159+0000", 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1482e-05 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053168+0000", 2023-11-19T00:40:38.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2709999999999992e-06 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053232+0000", 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4055999999999998e-05 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.053242+0000", 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0132000000000001e-05 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779572+0000", 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72633040100000001 2023-11-19T00:40:38.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779639+0000", 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6458999999999995e-05 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779727+0000", 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8529000000000006e-05 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.781311+0000", 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015839579999999999 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784347+0000", 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030354639999999999 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784365+0000", 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8686999999999999e-05 2023-11-19T00:40:38.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.784380+0000", 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4377e-05 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:2303 4.30 4:0f333bea:::10000000b1e.00000000:head [write 0~1572] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 30.881728401, 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72879382000000004, 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.061 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:38.062 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:38.062 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2303 2023-11-19T00:40:38.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.062 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054883+0000", 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054884+0000", 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8000000000000004e-07 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054889+0000", 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3090000000000003e-06 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054902+0000", 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2972999999999999e-05 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054914+0000", 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2139e-05 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054955+0000", 2023-11-19T00:40:38.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0652999999999999e-05 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.054961+0000", 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3810000000000004e-06 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778001+0000", 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.72303996299999995 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778074+0000", 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3112000000000001e-05 2023-11-19T00:40:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.778142+0000", 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8011999999999999e-05 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.779470+0000", 2023-11-19T00:40:38.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013274070000000001 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783585+0000", 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041150479999999996 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783635+0000", 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9796000000000002e-05 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:02.783677+0000", 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2147000000000002e-05 2023-11-19T00:40:38.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3575 3.13 3:ceffbd45:::200.0000000a:head [write 2562256~139962 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.733217+0000", 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.2033947319999996, 2023-11-19T00:40:38.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.95658131000000002, 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733217+0000", 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733217+0000", 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733219+0000", 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1210000000000001e-06 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733410+0000", 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019096200000000001 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733432+0000", 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2129000000000001e-05 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733442+0000", 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0353000000000001e-05 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733522+0000", 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0036000000000004e-05 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.733535+0000", 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3023000000000001e-05 2023-11-19T00:40:38.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685495+0000", 2023-11-19T00:40:38.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.95195965900000001 2023-11-19T00:40:38.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685599+0000", 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000103729 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685671+0000", 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2199000000000004e-05 2023-11-19T00:40:38.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688596+0000", 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029255330000000001 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689719+0000", 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011230470000000001 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689769+0000", 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9214e-05 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689798+0000", 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9305000000000001e-05 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3576 3.13 3:ceffbd45:::200.0000000a:head [write 2702218~10666 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.745980+0000", 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.1906309880000006, 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.94394634700000002, 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.745980+0000", 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.745980+0000", 2023-11-19T00:40:38.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.745982+0000", 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3769999999999999e-06 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746000+0000", 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8345000000000001e-05 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746015+0000", 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4817000000000001e-05 2023-11-19T00:40:38.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746023+0000", 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5769999999999996e-06 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746077+0000", 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4808000000000001e-05 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.746085+0000", 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.055e-06 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686377+0000", 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.940291828 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686422+0000", 2023-11-19T00:40:38.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4771000000000002e-05 2023-11-19T00:40:38.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686488+0000", 2023-11-19T00:40:38.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5870999999999993e-05 2023-11-19T00:40:38.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688602+0000", 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0021144750000000002 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689862+0000", 2023-11-19T00:40:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001259507 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689898+0000", 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5683999999999999e-05 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689927+0000", 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9232000000000001e-05 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.093 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4570.0:6657 4.3a 4:5c50f65b:::10000001be7.00000000:head [write 0~76] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.797787+0000", 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.1388246689999999, 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.89200668299999997, 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4570", 2023-11-19T00:40:38.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 6657 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797787+0000", 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797787+0000", 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797790+0000", 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8509999999999999e-06 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797803+0000", 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3054000000000001e-05 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797831+0000", 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8694e-05 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797845+0000", 2023-11-19T00:40:38.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.33e-05 2023-11-19T00:40:38.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797930+0000", 2023-11-19T00:40:38.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5082999999999998e-05 2023-11-19T00:40:38.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.797941+0000", 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1287999999999999e-05 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.684608+0000", 2023-11-19T00:40:38.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88666688299999996 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.684813+0000", 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020498099999999999 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.685208+0000", 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00039495399999999999 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686062+0000", 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00085440699999999995 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689702+0000", 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003640108 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689756+0000", 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3485e-05 2023-11-19T00:40:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689793+0000", 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7595000000000002e-05 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3577 3.13 3:ceffbd45:::200.0000000a:head [write 2712884~5175 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.800000+0000", 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.1366110620000001, 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.89000994600000005, 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800000+0000", 2023-11-19T00:40:38.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800000+0000", 2023-11-19T00:40:38.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800002+0000", 2023-11-19T00:40:38.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2759999999999999e-06 2023-11-19T00:40:38.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800015+0000", 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3529e-05 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800030+0000", 2023-11-19T00:40:38.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5203e-05 2023-11-19T00:40:38.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800039+0000", 2023-11-19T00:40:38.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0589999999999992e-06 2023-11-19T00:40:38.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800104+0000", 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4536999999999996e-05 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.800115+0000", 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1331e-05 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686890+0000", 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.88677472700000004 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.686941+0000", 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.147e-05 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687015+0000", 2023-11-19T00:40:38.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3188000000000005e-05 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688606+0000", 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001590876 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689964+0000", 2023-11-19T00:40:38.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013580160000000001 2023-11-19T00:40:38.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689992+0000", 2023-11-19T00:40:38.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8228000000000001e-05 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690010+0000", 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8505999999999999e-05 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3578 3.13 3:ceffbd45:::200.0000000a:head [write 2718059~2088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.850248+0000", 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.0863635909999996, 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83984525700000001, 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.116 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850248+0000", 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850248+0000", 2023-11-19T00:40:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850250+0000", 2023-11-19T00:40:38.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.193e-06 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850261+0000", 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0862e-05 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850281+0000", 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0415999999999999e-05 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850291+0000", 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0139999999999999e-05 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850367+0000", 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5099999999999996e-05 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850379+0000", 2023-11-19T00:40:38.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2856e-05 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687321+0000", 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83694129500000003 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687369+0000", 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8359999999999998e-05 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687442+0000", 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2885000000000004e-05 2023-11-19T00:40:38.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689343+0000", 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001901217 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690048+0000", 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00070510500000000003 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690075+0000", 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.656e-05 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690093+0000", 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8267999999999999e-05 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3580 3.13 3:ceffbd45:::200.0000000a:head [write 2720147~2766 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.850445+0000", 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.086166102, 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83973188899999995, 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850445+0000", 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850445+0000", 2023-11-19T00:40:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850446+0000", 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1100000000000002e-07 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850449+0000", 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.309e-06 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850453+0000", 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0899999999999998e-06 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850456+0000", 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7709999999999998e-06 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850497+0000", 2023-11-19T00:40:38.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1193999999999999e-05 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850505+0000", 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1610000000000003e-06 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687794+0000", 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83728891000000005 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687837+0000", 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2954000000000002e-05 2023-11-19T00:40:38.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.687909+0000", 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2230999999999993e-05 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.689347+0000", 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014378660000000001 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690123+0000", 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077553500000000005 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690150+0000", 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7668999999999999e-05 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690177+0000", 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6888000000000001e-05 2023-11-19T00:40:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(mds.0.3:3581 3.13 3:ceffbd45:::200.0000000a:head [write 2722913~1138 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.0861244600000006, 2023-11-19T00:40:38.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.83977273799999996, 2023-11-19T00:40:38.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2023-11-19T00:40:38.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.138 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2023-11-19T00:40:38.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2023-11-19T00:40:38.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:38.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850487+0000", 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2799999999999996e-07 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850491+0000", 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.196e-06 2023-11-19T00:40:38.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850495+0000", 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1949999999999996e-06 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850498+0000", 2023-11-19T00:40:38.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9000000000000002e-06 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850532+0000", 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3853000000000003e-05 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:24.850538+0000", 2023-11-19T00:40:38.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4139999999999999e-06 2023-11-19T00:40:38.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2023-11-19T00:40:38.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688160+0000", 2023-11-19T00:40:38.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.837621583 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688205+0000", 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4932000000000003e-05 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.688293+0000", 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8778999999999998e-05 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690207+0000", 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001913238 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690216+0000", 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.8069999999999994e-06 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690242+0000", 2023-11-19T00:40:38.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5262999999999999e-05 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2023-11-19T00:40:25.690260+0000", 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8050000000000002e-05 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-19T00:40:38.148 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-19T00:40:38.148 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-19T00:40:38.149 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2023-11-19T00:40:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:moved 2 / 210 (0.952381%) 2023-11-19T00:40:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:avg 70 2023-11-19T00:40:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:stddev 16.7531 -> 18.0185 (expected baseline 6.8313) 2023-11-19T00:40:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:min osd.0 with 50 -> 48 pgs (0.714286 -> 0.685714 * mean) 2023-11-19T00:40:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:max osd.2 with 89 -> 91 pgs (1.27143 -> 1.3 * mean) 2023-11-19T00:40:38.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:oload 110 2023-11-19T00:40:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:max_change 0.05 2023-11-19T00:40:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:max_change_osds 4 2023-11-19T00:40:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:average_utilization 0.0009 2023-11-19T00:40:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:overload_utilization 0.0010 2023-11-19T00:40:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 weight 0.7580 -> 0.8080 2023-11-19T00:40:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 weight 0.7248 -> 0.6749 2023-11-19T00:40:38.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-11-19T00:40:38.269 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:38.269 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:38.269 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2023-11-19T00:40:38.270 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:38.278 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-11-19T00:40:38.383 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:38.383 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2023-11-19T00:40:38.384 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2023-11-19T00:40:38.384 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2023-11-19T00:40:38.384 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:38.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-11-19T00:40:38.499 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-11-19T00:40:38.499 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2023-11-19T00:40:38.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2023-11-19T00:40:38.499 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.4461607, 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015278297, 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.500 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 28 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051035+0000", 2023-11-19T00:40:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.051038+0000", 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5299999999999999e-06 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055115+0000", 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040777529999999999 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055133+0000", 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8019000000000001e-05 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055145+0000", 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1335000000000001e-05 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055253+0000", 2023-11-19T00:40:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010796100000000001 2023-11-19T00:40:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055347+0000", 2023-11-19T00:40:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4734999999999993e-05 2023-11-19T00:40:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.055437+0000", 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9211999999999999e-05 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.062856+0000", 2023-11-19T00:40:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074197320000000001 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066252+0000", 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003395478 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066288+0000", 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5871999999999998e-05 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:39:59.066313+0000", 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.567e-05 2023-11-19T00:40:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2011 4.5 4:a3222028:::100000009fa.00000000:head [write 0~751] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.690486512, 2023-11-19T00:40:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.97185713799999995, 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2011 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806709+0000", 2023-11-19T00:40:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806710+0000", 2023-11-19T00:40:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5899999999999995e-07 2023-11-19T00:40:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806714+0000", 2023-11-19T00:40:38.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.782e-06 2023-11-19T00:40:38.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806724+0000", 2023-11-19T00:40:38.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7699999999999996e-06 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806729+0000", 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9320000000000004e-06 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806797+0000", 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8071000000000006e-05 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.806804+0000", 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8809999999999998e-06 2023-11-19T00:40:38.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.775987+0000", 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.96918338500000001 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776063+0000", 2023-11-19T00:40:38.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5831e-05 2023-11-19T00:40:38.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776134+0000", 2023-11-19T00:40:38.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1299999999999998e-05 2023-11-19T00:40:38.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777736+0000", 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016014930000000001 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778520+0000", 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078471200000000002 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778547+0000", 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6662999999999999e-05 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778566+0000", 2023-11-19T00:40:38.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9559e-05 2023-11-19T00:40:38.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.522 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2083 4.5 4:a15108f7:::10000000a42.00000000:head [write 0~543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.628022735999998, 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90951697399999998, 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.523 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2083 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:38.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869173+0000", 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869175+0000", 2023-11-19T00:40:38.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9130000000000001e-06 2023-11-19T00:40:38.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869184+0000", 2023-11-19T00:40:38.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3670000000000003e-06 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869212+0000", 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7203e-05 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869245+0000", 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3383000000000002e-05 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869327+0000", 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1922000000000006e-05 2023-11-19T00:40:38.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.869337+0000", 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0231000000000001e-05 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776573+0000", 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.90723579200000004 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776645+0000", 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2591999999999999e-05 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776717+0000", 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1658999999999999e-05 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777777+0000", 2023-11-19T00:40:38.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010600749999999999 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778651+0000", 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087379199999999997 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778673+0000", 2023-11-19T00:40:38.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2447e-05 2023-11-19T00:40:38.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778690+0000", 2023-11-19T00:40:38.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6597999999999999e-05 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2203 4.5 4:a07eade1:::10000000aba.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:38.534 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.527443386999998, 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80897613400000001, 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2203 2023-11-19T00:40:38.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.536 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:38.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969752+0000", 2023-11-19T00:40:38.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969753+0000", 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7000000000000004e-07 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969756+0000", 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.343e-06 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969766+0000", 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9359999999999994e-06 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969773+0000", 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9809999999999997e-06 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969818+0000", 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5117999999999997e-05 2023-11-19T00:40:38.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:01.969825+0000", 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6939999999999998e-06 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.776938+0000", 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.80711290499999999 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777007+0000", 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8813999999999995e-05 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777076+0000", 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8633999999999994e-05 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778610+0000", 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001534281 2023-11-19T00:40:38.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778694+0000", 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4258999999999994e-05 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778714+0000", 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0271999999999998e-05 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778729+0000", 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4226999999999999e-05 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.546 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2396 4.5 4:a1c5aa6b:::10000000b7b.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.546 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:38.546 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.362132608000003, 2023-11-19T00:40:38.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64593897600000005, 2023-11-19T00:40:38.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2396 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135063+0000", 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135064+0000", 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9299999999999998e-07 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135067+0000", 2023-11-19T00:40:38.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.078e-06 2023-11-19T00:40:38.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135074+0000", 2023-11-19T00:40:38.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1189999999999999e-06 2023-11-19T00:40:38.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135080+0000", 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8030000000000002e-06 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135121+0000", 2023-11-19T00:40:38.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0754999999999999e-05 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.135128+0000", 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0570000000000004e-06 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777291+0000", 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.64216368300000004 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777384+0000", 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2658999999999995e-05 2023-11-19T00:40:38.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777460+0000", 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6515999999999997e-05 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778644+0000", 2023-11-19T00:40:38.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001183709 2023-11-19T00:40:38.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780953+0000", 2023-11-19T00:40:38.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023092579999999998 2023-11-19T00:40:38.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780979+0000", 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781002+0000", 2023-11-19T00:40:38.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3206000000000001e-05 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2414 4.5 4:a2bb020c:::10000000b8d.00000000:head [write 0~3054] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:38.557 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.346613458, 2023-11-19T00:40:38.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.63053273799999998, 2023-11-19T00:40:38.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.558 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.558 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.558 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.558 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2414 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150582+0000", 2023-11-19T00:40:38.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150583+0000", 2023-11-19T00:40:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.02e-06 2023-11-19T00:40:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150590+0000", 2023-11-19T00:40:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7530000000000004e-06 2023-11-19T00:40:38.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150620+0000", 2023-11-19T00:40:38.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9896e-05 2023-11-19T00:40:38.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150625+0000", 2023-11-19T00:40:38.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3000000000000001e-06 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150674+0000", 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8495000000000002e-05 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.150684+0000", 2023-11-19T00:40:38.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0094e-05 2023-11-19T00:40:38.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777802+0000", 2023-11-19T00:40:38.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.627117963 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777866+0000", 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4508e-05 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.777935+0000", 2023-11-19T00:40:38.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8887999999999995e-05 2023-11-19T00:40:38.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779576+0000", 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016409549999999999 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781074+0000", 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014973230000000001 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781098+0000", 2023-11-19T00:40:38.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4868e-05 2023-11-19T00:40:38.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781115+0000", 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6674999999999999e-05 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2491 4.5 4:a181e62e:::10000000bdb.00000000:head [write 0~93] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.570 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:38.571 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.280822368000003, 2023-11-19T00:40:38.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56518434900000003, 2023-11-19T00:40:38.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2491 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216373+0000", 2023-11-19T00:40:38.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216374+0000", 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5799999999999999e-07 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216377+0000", 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3299999999999999e-06 2023-11-19T00:40:38.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216392+0000", 2023-11-19T00:40:38.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4756999999999999e-05 2023-11-19T00:40:38.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216397+0000", 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7299999999999996e-06 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216444+0000", 2023-11-19T00:40:38.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6718999999999998e-05 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.216450+0000", 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1789999999999996e-06 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778139+0000", 2023-11-19T00:40:38.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.56168952000000005 2023-11-19T00:40:38.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778207+0000", 2023-11-19T00:40:38.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7273000000000005e-05 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778295+0000", 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8282999999999995e-05 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780085+0000", 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001789646 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781517+0000", 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001432064 2023-11-19T00:40:38.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781540+0000", 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3357999999999999e-05 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781558+0000", 2023-11-19T00:40:38.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7832000000000001e-05 2023-11-19T00:40:38.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.582 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.582 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2699 4.5 4:a3b5730f:::10000000cae.00000000:head [write 0~6648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.100948684000002, 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38534984100000003, 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.583 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2699 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396247+0000", 2023-11-19T00:40:38.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396248+0000", 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5600000000000005e-07 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396257+0000", 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8769999999999999e-06 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396267+0000", 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0721e-05 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396275+0000", 2023-11-19T00:40:38.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7200000000000006e-06 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396314+0000", 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8510999999999998e-05 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.396320+0000", 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8100000000000003e-06 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778757+0000", 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.38243702899999998 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778823+0000", 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5957000000000006e-05 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.778925+0000", 2023-11-19T00:40:38.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102187 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781035+0000", 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021106279999999998 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781562+0000", 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00052672500000000002 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781583+0000", 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781597+0000", 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4328000000000001e-05 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.594 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2783 4.5 4:a2251628:::10000000d02.00000000:head [write 0~587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.594 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:38.594 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.027844027999997, 2023-11-19T00:40:38.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31228335499999998, 2023-11-19T00:40:38.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.595 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.595 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.595 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.595 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2783 2023-11-19T00:40:38.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.595 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:38.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469352+0000", 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7000000000000005e-07 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469356+0000", 2023-11-19T00:40:38.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5580000000000001e-06 2023-11-19T00:40:38.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469362+0000", 2023-11-19T00:40:38.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4489999999999996e-06 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469368+0000", 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469417+0000", 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9175000000000003e-05 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.469428+0000", 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0686000000000001e-05 2023-11-19T00:40:38.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779211+0000", 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30978378600000001 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779281+0000", 2023-11-19T00:40:38.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0034000000000001e-05 2023-11-19T00:40:38.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779349+0000", 2023-11-19T00:40:38.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7563000000000003e-05 2023-11-19T00:40:38.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781067+0000", 2023-11-19T00:40:38.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017179439999999999 2023-11-19T00:40:38.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781601+0000", 2023-11-19T00:40:38.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053379899999999995 2023-11-19T00:40:38.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781621+0000", 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0021e-05 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781635+0000", 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4389999999999999e-05 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2841 4.5 4:a2b9966d:::10000000d3f.00000000:head [write 0~182] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.976146868000001, 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.26062358299999999, 2023-11-19T00:40:38.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2841 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521049+0000", 2023-11-19T00:40:38.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521050+0000", 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2399999999999997e-07 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521054+0000", 2023-11-19T00:40:38.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7969999999999998e-06 2023-11-19T00:40:38.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521064+0000", 2023-11-19T00:40:38.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0173999999999999e-05 2023-11-19T00:40:38.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521069+0000", 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4650000000000002e-06 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521109+0000", 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9863000000000001e-05 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.521115+0000", 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9610000000000002e-06 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779597+0000", 2023-11-19T00:40:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.258481774 2023-11-19T00:40:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779688+0000", 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1216000000000002e-05 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.779774+0000", 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6273000000000006e-05 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781135+0000", 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00136089 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781639+0000", 2023-11-19T00:40:38.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050348400000000001 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781659+0000", 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0015999999999999e-05 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781673+0000", 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3845999999999999e-05 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.619 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2878 4.5 4:a1accb27:::10000000d67.00000000:head [write 0~49] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.941755889, 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.23025111700000001, 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2878 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555440+0000", 2023-11-19T00:40:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555441+0000", 2023-11-19T00:40:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9100000000000003e-07 2023-11-19T00:40:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555445+0000", 2023-11-19T00:40:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.997e-06 2023-11-19T00:40:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555451+0000", 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.781e-06 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555456+0000", 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7430000000000002e-06 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555497+0000", 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0457999999999998e-05 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.555503+0000", 2023-11-19T00:40:38.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5400000000000001e-06 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780124+0000", 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.224620599 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780204+0000", 2023-11-19T00:40:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0743999999999998e-05 2023-11-19T00:40:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780333+0000", 2023-11-19T00:40:38.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128713 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781707+0000", 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00137407 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785617+0000", 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039098939999999997 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785666+0000", 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8649000000000001e-05 2023-11-19T00:40:38.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785691+0000", 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5238000000000001e-05 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2890 4.5 4:a18e9907:::10000000d73.00000000:head [write 0~1262] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.931311682999997, 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.219849978, 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.632 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2890 2023-11-19T00:40:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565884+0000", 2023-11-19T00:40:38.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565885+0000", 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.125e-06 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565890+0000", 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5519999999999998e-06 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565902+0000", 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1749000000000001e-05 2023-11-19T00:40:38.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565907+0000", 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7579999999999998e-06 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565959+0000", 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1789000000000002e-05 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.565967+0000", 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.464e-06 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780627+0000", 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.214660776 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780696+0000", 2023-11-19T00:40:38.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8913999999999998e-05 2023-11-19T00:40:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.780766+0000", 2023-11-19T00:40:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9654999999999996e-05 2023-11-19T00:40:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.782439+0000", 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016734429999999999 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785696+0000", 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032570339999999998 2023-11-19T00:40:38.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785719+0000", 2023-11-19T00:40:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2538999999999999e-05 2023-11-19T00:40:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785734+0000", 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.518e-05 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:2914 4.5 4:a3bcd1d5:::10000000d8b.00000000:head [write 0~9] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.643 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.910454612000002, 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.19903089600000001, 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.644 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2914 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586741+0000", 2023-11-19T00:40:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586742+0000", 2023-11-19T00:40:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2699999999999999e-07 2023-11-19T00:40:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586746+0000", 2023-11-19T00:40:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6679999999999999e-06 2023-11-19T00:40:38.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586754+0000", 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.952e-06 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586760+0000", 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.767e-06 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586799+0000", 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9125999999999998e-05 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.586806+0000", 2023-11-19T00:40:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8299999999999998e-06 2023-11-19T00:40:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781151+0000", 2023-11-19T00:40:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.194345292 2023-11-19T00:40:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781238+0000", 2023-11-19T00:40:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6184e-05 2023-11-19T00:40:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781310+0000", 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2823000000000004e-05 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783096+0000", 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017855659999999999 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785737+0000", 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026411109999999998 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785756+0000", 2023-11-19T00:40:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9079000000000001e-05 2023-11-19T00:40:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785772+0000", 2023-11-19T00:40:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5871000000000001e-05 2023-11-19T00:40:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4570.0:3080 4.5 4:a208ff9e:::10000000e30.00000000:head [write 0~219] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.748653419999997, 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.037266782999999998, 2023-11-19T00:40:38.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2023-11-19T00:40:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4570", 2023-11-19T00:40:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "192.168.0.1:0/3327688873", 2023-11-19T00:40:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 3080 2023-11-19T00:40:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.657 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748542+0000", 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748543+0000", 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5099999999999999e-07 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748547+0000", 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9840000000000003e-06 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748557+0000", 2023-11-19T00:40:38.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0166999999999999e-05 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748563+0000", 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4569999999999996e-06 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748600+0000", 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7435000000000003e-05 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.748606+0000", 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2430000000000002e-06 2023-11-19T00:40:38.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781731+0000", 2023-11-19T00:40:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033124149999999998 2023-11-19T00:40:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781795+0000", 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4163000000000002e-05 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.781863+0000", 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8440000000000002e-05 2023-11-19T00:40:38.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.783759+0000", 2023-11-19T00:40:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018959719999999999 2023-11-19T00:40:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785775+0000", 2023-11-19T00:40:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020159850000000001 2023-11-19T00:40:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785795+0000", 2023-11-19T00:40:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9792e-05 2023-11-19T00:40:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:02.785809+0000", 2023-11-19T00:40:38.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4243999999999999e-05 2023-11-19T00:40:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:149 3.1a 3:5e41ab69:::200.00000005:head [write 68983~4125321 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e43)", 2023-11-19T00:40:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.140487942, 2023-11-19T00:40:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016859481999999999, 2023-11-19T00:40:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356708+0000", 2023-11-19T00:40:38.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.356709+0000", 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.23e-07 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362351+0000", 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0056426599999999999 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362360+0000", 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8729999999999996e-06 2023-11-19T00:40:38.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362365+0000", 2023-11-19T00:40:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362407+0000", 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2066e-05 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362454+0000", 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6662000000000001e-05 2023-11-19T00:40:38.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.362520+0000", 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6261999999999997e-05 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.370846+0000", 2023-11-19T00:40:38.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083262240000000001 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373515+0000", 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026680620000000001 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373547+0000", 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2772999999999999e-05 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:06.373567+0000", 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0074000000000001e-05 2023-11-19T00:40:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(mds.0.3:151 3.1e e44/16 3:7bf7e7b5:::200.00000006:head v 44'2, mlcod=0'0)", 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.493123702999998, 2023-11-19T00:40:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015127307, 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004072+0000", 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.004073+0000", 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3e-07 2023-11-19T00:40:38.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.011990+0000", 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079172099999999992 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012003+0000", 2023-11-19T00:40:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2744e-05 2023-11-19T00:40:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012007+0000", 2023-11-19T00:40:38.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4850000000000003e-06 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012050+0000", 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2713999999999998e-05 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.012069+0000", 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8953999999999998e-05 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019154+0000", 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070846829999999996 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.019199+0000", 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5887000000000003e-05 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.679019236999999, 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022384265, 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.818177+0000", 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9200000000000001e-07 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824119+0000", 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059418190000000001 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824127+0000", 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000008e-06 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824131+0000", 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4920000000000004e-06 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824167+0000", 2023-11-19T00:40:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5675e-05 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824221+0000", 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4199000000000001e-05 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.824417+0000", 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000196195 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.832941+0000", 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0085240320000000008 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840477+0000", 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007535305 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840526+0000", 2023-11-19T00:40:38.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9084e-05 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:07.840561+0000", 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5104000000000001e-05 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3393 4.5 4:a3c557f2:::10000001b6d.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.678428067999999, 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0254170279999999, 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.695 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818768+0000", 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818770+0000", 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2023-11-19T00:40:38.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818795+0000", 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4555000000000001e-05 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818810+0000", 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5359e-05 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818821+0000", 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818886+0000", 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5424000000000002e-05 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818891+0000", 2023-11-19T00:40:38.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6800000000000001e-06 2023-11-19T00:40:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834587+0000", 2023-11-19T00:40:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015695962000000001 2023-11-19T00:40:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834597+0000", 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5580000000000006e-06 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839154+0000", 2023-11-19T00:40:38.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0045572659999999 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839276+0000", 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121908 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839381+0000", 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0001053 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840806+0000", 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424717 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840819+0000", 2023-11-19T00:40:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2911999999999999e-05 2023-11-19T00:40:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844062+0000", 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003242951 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844105+0000", 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3149000000000003e-05 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.844185+0000", 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0037000000000006e-05 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.707 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3434 4.5 4:a059f840:::10000001b44.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.678349183999998, 2023-11-19T00:40:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0269672240000001, 2023-11-19T00:40:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2023-11-19T00:40:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:38.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818847+0000", 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818850+0000", 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3290000000000001e-06 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818855+0000", 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5940000000000001e-06 2023-11-19T00:40:38.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818861+0000", 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5770000000000001e-06 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818947+0000", 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6001999999999994e-05 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818953+0000", 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.37e-06 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834620+0000", 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015667103000000002 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834628+0000", 2023-11-19T00:40:38.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1709999999999996e-06 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839852+0000", 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0052246499999999 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.839967+0000", 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114296 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845814+0000", 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058473659999999997 2023-11-19T00:40:38.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(mds.0.3:3444 4.5 4:a216e078:::10000001b1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e50)", 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.678311298000001, 2023-11-19T00:40:38.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0271058879999999, 2023-11-19T00:40:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2023-11-19T00:40:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2023-11-19T00:40:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2023-11-19T00:40:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:38.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2023-11-19T00:40:38.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818885+0000", 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1699999999999999e-07 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818888+0000", 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6010000000000002e-06 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818895+0000", 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4109999999999999e-06 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818900+0000", 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3569999999999997e-06 2023-11-19T00:40:38.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818971+0000", 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0581999999999996e-05 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:38.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.818974+0000", 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0479999999999999e-06 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834649+0000", 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01567474 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:19.834652+0000", 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.647e-06 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840261+0000", 2023-11-19T00:40:38.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0056082340000001 2023-11-19T00:40:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2023-11-19T00:40:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840365+0000", 2023-11-19T00:40:38.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010438300000000001 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0,2", 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840468+0000", 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103427 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.840963+0000", 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049454399999999997 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.841179+0000", 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021634099999999999 2023-11-19T00:40:38.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845862+0000", 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00468295 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845903+0000", 2023-11-19T00:40:38.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0920000000000001e-05 2023-11-19T00:40:38.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-11-19T00:40:38.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2023-11-19T00:40:38.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2023-11-19T00:40:38.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2023-11-19T00:40:20.845990+0000", 2023-11-19T00:40:38.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7286000000000004e-05 2023-11-19T00:40:38.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-11-19T00:40:38.730 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2023-11-19T00:40:38.730 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-11-19T00:40:38.731 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-11-19T00:40:38.848 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:38.848 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:38.848 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2023-11-19T00:40:38.848 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:38.857 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-11-19T00:40:38.962 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:38.963 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2023-11-19T00:40:38.963 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2023-11-19T00:40:38.963 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2023-11-19T00:40:38.963 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:38.971 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-11-19T00:40:39.079 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2023-11-19T00:40:39.079 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2023-11-19T00:40:39.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2023-11-19T00:40:39.079 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2023-11-19T00:40:39.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.079 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:39.080 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:39.080 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 124.446779155, 2023-11-19T00:40:39.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366180439999999, 2023-11-19T00:40:39.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.080 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.080 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:39.080 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:39.081 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:39.081 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2023-11-19T00:40:39.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.081 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630104+0000", 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630106+0000", 2023-11-19T00:40:39.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4470000000000001e-06 2023-11-19T00:40:39.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630112+0000", 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6590000000000001e-06 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630122+0000", 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6090000000000007e-06 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630130+0000", 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0120000000000005e-06 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630184+0000", 2023-11-19T00:40:39.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4639999999999999e-05 2023-11-19T00:40:39.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2023-11-19T00:40:39.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:34.630193+0000", 2023-11-19T00:40:39.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2190000000000004e-06 2023-11-19T00:40:39.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665310+0000", 2023-11-19T00:40:39.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0351177840000001 2023-11-19T00:40:39.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665446+0000", 2023-11-19T00:40:39.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013563 2023-11-19T00:40:39.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.665604+0000", 2023-11-19T00:40:39.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015806500000000001 2023-11-19T00:40:39.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666188+0000", 2023-11-19T00:40:39.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00058364099999999998 2023-11-19T00:40:39.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666662+0000", 2023-11-19T00:40:39.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047409900000000002 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666697+0000", 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5080999999999998e-05 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:35.666722+0000", 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5157999999999999e-05 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.092 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 122.920966562, 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012663298, 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:39.093 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:39.094 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 139 2023-11-19T00:40:39.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.094 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:39.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:39.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155917+0000", 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9299999999999998e-07 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155922+0000", 2023-11-19T00:40:39.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9230000000000001e-06 2023-11-19T00:40:39.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155928+0000", 2023-11-19T00:40:39.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3269999999999997e-06 2023-11-19T00:40:39.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155933+0000", 2023-11-19T00:40:39.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0289999999999996e-06 2023-11-19T00:40:39.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161328+0000", 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053945349999999998 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161406+0000", 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8263999999999995e-05 2023-11-19T00:40:39.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161525+0000", 2023-11-19T00:40:39.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119024 2023-11-19T00:40:39.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163435+0000", 2023-11-19T00:40:39.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019097910000000001 2023-11-19T00:40:39.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168513+0000", 2023-11-19T00:40:39.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050779400000000004 2023-11-19T00:40:39.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168548+0000", 2023-11-19T00:40:39.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5299000000000002e-05 2023-11-19T00:40:39.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168580+0000", 2023-11-19T00:40:39.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1673e-05 2023-11-19T00:40:39.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.103 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.104 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:39.104 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:39.104 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 122.920941172, 2023-11-19T00:40:39.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012683501, 2023-11-19T00:40:39.104 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.105 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.105 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:39.105 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:39.105 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:39.105 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 140 2023-11-19T00:40:39.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.105 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155942+0000", 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.155943+0000", 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6199999999999998e-07 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156020+0000", 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7406999999999999e-05 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156032+0000", 2023-11-19T00:40:39.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1603000000000001e-05 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.156037+0000", 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9060000000000001e-06 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161891+0000", 2023-11-19T00:40:39.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058543170000000004 2023-11-19T00:40:39.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.161941+0000", 2023-11-19T00:40:39.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9733e-05 2023-11-19T00:40:39.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.162016+0000", 2023-11-19T00:40:39.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5173999999999995e-05 2023-11-19T00:40:39.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.163467+0000", 2023-11-19T00:40:39.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014516170000000001 2023-11-19T00:40:39.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168585+0000", 2023-11-19T00:40:39.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051178059999999999 2023-11-19T00:40:39.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168609+0000", 2023-11-19T00:40:39.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3586000000000001e-05 2023-11-19T00:40:39.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.168626+0000", 2023-11-19T00:40:39.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.679e-05 2023-11-19T00:40:39.115 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.115 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.115 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4164.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 122.520165445, 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013941939, 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.116 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4164", 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.46:0/1097694524", 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 189 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:39.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:39.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556718+0000", 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-07 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556720+0000", 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0820000000000001e-06 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556724+0000", 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1520000000000002e-06 2023-11-19T00:40:39.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.556727+0000", 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5509999999999998e-06 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562327+0000", 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056003219999999996 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562399+0000", 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1997999999999997e-05 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.562522+0000", 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012240100000000001 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.563433+0000", 2023-11-19T00:40:39.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091098199999999996 2023-11-19T00:40:39.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570573+0000", 2023-11-19T00:40:39.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071401650000000004 2023-11-19T00:40:39.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570627+0000", 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4675000000000001e-05 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:36.570660+0000", 2023-11-19T00:40:39.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2298999999999997e-05 2023-11-19T00:40:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.126 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:39.127 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.30936210199999, 2023-11-19T00:40:39.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013688878999999999, 2023-11-19T00:40:39.127 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.127 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.127 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767521+0000", 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767523+0000", 2023-11-19T00:40:39.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8759999999999999e-06 2023-11-19T00:40:39.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767531+0000", 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4649999999999997e-06 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767543+0000", 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2660000000000001e-05 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.767561+0000", 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.802e-05 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769787+0000", 2023-11-19T00:40:39.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002226301 2023-11-19T00:40:39.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:39.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769797+0000", 2023-11-19T00:40:39.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2269999999999999e-06 2023-11-19T00:40:39.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777284+0000", 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074876359999999998 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777510+0000", 2023-11-19T00:40:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022555000000000001 2023-11-19T00:40:39.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777630+0000", 2023-11-19T00:40:39.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120283 2023-11-19T00:40:39.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780014+0000", 2023-11-19T00:40:39.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023835509999999998 2023-11-19T00:40:39.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781064+0000", 2023-11-19T00:40:39.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001050453 2023-11-19T00:40:39.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781108+0000", 2023-11-19T00:40:39.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3930000000000001e-05 2023-11-19T00:40:39.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781210+0000", 2023-11-19T00:40:39.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101927 2023-11-19T00:40:39.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.308871384, 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019316437999999998, 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.139 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.140 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:39.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768012+0000", 2023-11-19T00:40:39.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768013+0000", 2023-11-19T00:40:39.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1299999999999998e-07 2023-11-19T00:40:39.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768018+0000", 2023-11-19T00:40:39.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6099999999999997e-06 2023-11-19T00:40:39.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768031+0000", 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2153999999999999e-05 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768048+0000", 2023-11-19T00:40:39.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7156e-05 2023-11-19T00:40:39.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769873+0000", 2023-11-19T00:40:39.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018256489999999999 2023-11-19T00:40:39.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769881+0000", 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2790000000000001e-06 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777924+0000", 2023-11-19T00:40:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080434640000000002 2023-11-19T00:40:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777997+0000", 2023-11-19T00:40:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2590999999999997e-05 2023-11-19T00:40:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778129+0000", 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132416 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780933+0000", 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028034739999999998 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787271+0000", 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063384820000000003 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787307+0000", 2023-11-19T00:40:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6259e-05 2023-11-19T00:40:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787328+0000", 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0990999999999999e-05 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.308818761, 2023-11-19T00:40:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019362959999999999, 2023-11-19T00:40:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768065+0000", 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2500000000000005e-07 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768083+0000", 2023-11-19T00:40:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7581e-05 2023-11-19T00:40:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768099+0000", 2023-11-19T00:40:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5688999999999998e-05 2023-11-19T00:40:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.768116+0000", 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7104000000000001e-05 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770106+0000", 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019905299999999999 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770117+0000", 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778497+0000", 2023-11-19T00:40:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0083807329999999996 2023-11-19T00:40:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778619+0000", 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121161 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778767+0000", 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014896700000000001 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781010+0000", 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002242179 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787373+0000", 2023-11-19T00:40:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063628540000000003 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787406+0000", 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3238999999999998e-05 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787427+0000", 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1698000000000001e-05 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.307342312, 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017967159, 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769541+0000", 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769542+0000", 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3799999999999996e-07 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769548+0000", 2023-11-19T00:40:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8429999999999998e-06 2023-11-19T00:40:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769562+0000", 2023-11-19T00:40:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4538999999999999e-05 2023-11-19T00:40:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769571+0000", 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0059999999999998e-06 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770168+0000", 2023-11-19T00:40:39.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059707300000000005 2023-11-19T00:40:39.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770179+0000", 2023-11-19T00:40:39.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0288e-05 2023-11-19T00:40:39.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779061+0000", 2023-11-19T00:40:39.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088826159999999994 2023-11-19T00:40:39.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779155+0000", 2023-11-19T00:40:39.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3882999999999995e-05 2023-11-19T00:40:39.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779747+0000", 2023-11-19T00:40:39.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059191799999999998 2023-11-19T00:40:39.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783502+0000", 2023-11-19T00:40:39.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037548379999999999 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787458+0000", 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039558639999999999 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787490+0000", 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2453000000000003e-05 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787508+0000", 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8e-05 2023-11-19T00:40:39.173 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.174 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.174 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:39.174 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.307298053, 2023-11-19T00:40:39.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018053772999999999, 2023-11-19T00:40:39.175 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.175 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.175 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:39.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769585+0000", 2023-11-19T00:40:39.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769586+0000", 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4499999999999997e-07 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769590+0000", 2023-11-19T00:40:39.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8260000000000003e-06 2023-11-19T00:40:39.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769598+0000", 2023-11-19T00:40:39.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1589999999999993e-06 2023-11-19T00:40:39.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769604+0000", 2023-11-19T00:40:39.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0090000000000004e-06 2023-11-19T00:40:39.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770206+0000", 2023-11-19T00:40:39.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060208400000000002 2023-11-19T00:40:39.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770210+0000", 2023-11-19T00:40:39.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.754e-06 2023-11-19T00:40:39.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780130+0000", 2023-11-19T00:40:39.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0099202909999999995 2023-11-19T00:40:39.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780329+0000", 2023-11-19T00:40:39.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000199187 2023-11-19T00:40:39.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780676+0000", 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000347074 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783507+0000", 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028311529999999999 2023-11-19T00:40:39.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787552+0000", 2023-11-19T00:40:39.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040442799999999999 2023-11-19T00:40:39.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787605+0000", 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2988000000000002e-05 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787639+0000", 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4323000000000003e-05 2023-11-19T00:40:39.185 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.186 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.186 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.186 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:39.186 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.307255649, 2023-11-19T00:40:39.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018088735000000002, 2023-11-19T00:40:39.187 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.187 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.187 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769628+0000", 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769629+0000", 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.074e-06 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769635+0000", 2023-11-19T00:40:39.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5180000000000001e-06 2023-11-19T00:40:39.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769646+0000", 2023-11-19T00:40:39.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0793e-05 2023-11-19T00:40:39.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769660+0000", 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3651e-05 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770295+0000", 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00063511500000000001 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770300+0000", 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2599999999999996e-06 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781404+0000", 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011103817 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781524+0000", 2023-11-19T00:40:39.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012003 2023-11-19T00:40:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781661+0000", 2023-11-19T00:40:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013714700000000001 2023-11-19T00:40:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783513+0000", 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00185158 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787667+0000", 2023-11-19T00:40:39.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041546120000000002 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787697+0000", 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9969999999999999e-05 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787716+0000", 2023-11-19T00:40:39.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9168e-05 2023-11-19T00:40:39.197 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.197 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.197 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.198 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.198 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:39.198 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.307208808, 2023-11-19T00:40:39.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020533339000000001, 2023-11-19T00:40:39.198 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.198 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769674+0000", 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769675+0000", 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3300000000000002e-07 2023-11-19T00:40:39.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769680+0000", 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0150000000000003e-06 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769688+0000", 2023-11-19T00:40:39.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8220000000000007e-06 2023-11-19T00:40:39.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769694+0000", 2023-11-19T00:40:39.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8819999999999998e-06 2023-11-19T00:40:39.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770336+0000", 2023-11-19T00:40:39.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064191300000000003 2023-11-19T00:40:39.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770340+0000", 2023-11-19T00:40:39.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3200000000000001e-06 2023-11-19T00:40:39.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782421+0000", 2023-11-19T00:40:39.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012080924999999999 2023-11-19T00:40:39.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782534+0000", 2023-11-19T00:40:39.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011296199999999999 2023-11-19T00:40:39.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.782736+0000", 2023-11-19T00:40:39.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020158599999999999 2023-11-19T00:40:39.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784905+0000", 2023-11-19T00:40:39.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021697740000000002 2023-11-19T00:40:39.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790148+0000", 2023-11-19T00:40:39.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052431789999999997 2023-11-19T00:40:39.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790185+0000", 2023-11-19T00:40:39.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6727000000000003e-05 2023-11-19T00:40:39.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790208+0000", 2023-11-19T00:40:39.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2600999999999999e-05 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:39.210 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.307137561, 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020567122, 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:39.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769746+0000", 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4300000000000003e-07 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769750+0000", 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0709999999999996e-06 2023-11-19T00:40:39.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769761+0000", 2023-11-19T00:40:39.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2023-11-19T00:40:39.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769769+0000", 2023-11-19T00:40:39.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0679999999999997e-06 2023-11-19T00:40:39.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770365+0000", 2023-11-19T00:40:39.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00059581 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770370+0000", 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1030000000000001e-06 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784347+0000", 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013977027 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784654+0000", 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030688200000000002 2023-11-19T00:40:39.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784737+0000", 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2898000000000005e-05 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.785464+0000", 2023-11-19T00:40:39.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00072644099999999998 2023-11-19T00:40:39.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790251+0000", 2023-11-19T00:40:39.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004787309 2023-11-19T00:40:39.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790289+0000", 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.79e-05 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.790313+0000", 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4093000000000001e-05 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.221 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:39.222 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.30694112499999, 2023-11-19T00:40:39.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014136376000000001, 2023-11-19T00:40:39.222 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.222 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.222 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:39.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769942+0000", 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769943+0000", 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.71e-07 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769962+0000", 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9099000000000001e-05 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769972+0000", 2023-11-19T00:40:39.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8139999999999995e-06 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769981+0000", 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0270000000000001e-06 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770095+0000", 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011438999999999999 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770101+0000", 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5990000000000001e-06 2023-11-19T00:40:39.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779627+0000", 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095264470000000004 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779730+0000", 2023-11-19T00:40:39.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010303599999999999 2023-11-19T00:40:39.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:39.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779904+0000", 2023-11-19T00:40:39.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017340899999999999 2023-11-19T00:40:39.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781576+0000", 2023-11-19T00:40:39.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016719199999999999 2023-11-19T00:40:39.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002332359 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783987+0000", 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8478000000000003e-05 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784079+0000", 2023-11-19T00:40:39.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1927000000000003e-05 2023-11-19T00:40:39.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.30688937399999, 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014366744000000001, 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.233 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:39.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769994+0000", 2023-11-19T00:40:39.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769995+0000", 2023-11-19T00:40:39.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8800000000000002e-07 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.769998+0000", 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.472e-06 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770005+0000", 2023-11-19T00:40:39.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1029999999999996e-06 2023-11-19T00:40:39.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770015+0000", 2023-11-19T00:40:39.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0327e-05 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770281+0000", 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026510900000000003 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770358+0000", 2023-11-19T00:40:39.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7656000000000003e-05 2023-11-19T00:40:39.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780387+0000", 2023-11-19T00:40:39.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010028361 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780460+0000", 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3554999999999996e-05 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780616+0000", 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155945 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.781992+0000", 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001375687 2023-11-19T00:40:39.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784145+0000", 2023-11-19T00:40:39.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021530529999999998 2023-11-19T00:40:39.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784307+0000", 2023-11-19T00:40:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016261300000000001 2023-11-19T00:40:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784361+0000", 2023-11-19T00:40:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.3174999999999998e-05 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:39.244 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.306683925, 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013632714000000001, 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:39.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770199+0000", 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770200+0000", 2023-11-19T00:40:39.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.61e-07 2023-11-19T00:40:39.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770212+0000", 2023-11-19T00:40:39.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2255e-05 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770222+0000", 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0040999999999999e-05 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770229+0000", 2023-11-19T00:40:39.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8499999999999996e-06 2023-11-19T00:40:39.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770391+0000", 2023-11-19T00:40:39.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000161535 2023-11-19T00:40:39.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2023-11-19T00:40:39.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770397+0000", 2023-11-19T00:40:39.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9259999999999997e-06 2023-11-19T00:40:39.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776759+0000", 2023-11-19T00:40:39.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063621340000000002 2023-11-19T00:40:39.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.776962+0000", 2023-11-19T00:40:39.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020315700000000001 2023-11-19T00:40:39.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777321+0000", 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000358804 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778919+0000", 2023-11-19T00:40:39.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015978190000000001 2023-11-19T00:40:39.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783692+0000", 2023-11-19T00:40:39.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047738429999999998 2023-11-19T00:40:39.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783780+0000", 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7936999999999995e-05 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783832+0000", 2023-11-19T00:40:39.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.1651999999999999e-05 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:39.256 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.30663298899999, 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017074500999999999, 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:39.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770250+0000", 2023-11-19T00:40:39.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770251+0000", 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.13e-07 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770255+0000", 2023-11-19T00:40:39.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9009999999999996e-06 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770262+0000", 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3590000000000002e-06 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770303+0000", 2023-11-19T00:40:39.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0905000000000002e-05 2023-11-19T00:40:39.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770403+0000", 2023-11-19T00:40:39.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9821000000000005e-05 2023-11-19T00:40:39.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770408+0000", 2023-11-19T00:40:39.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6069999999999998e-06 2023-11-19T00:40:39.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777868+0000", 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0074592260000000002 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777970+0000", 2023-11-19T00:40:39.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102291 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778096+0000", 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126274 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780368+0000", 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022714300000000001 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787251+0000", 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068828279999999997 2023-11-19T00:40:39.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787296+0000", 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5219999999999997e-05 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787325+0000", 2023-11-19T00:40:39.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9026e-05 2023-11-19T00:40:39.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.267 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.267 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.30619460699999, 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016798791, 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:39.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:39.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770689+0000", 2023-11-19T00:40:39.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5099999999999999e-07 2023-11-19T00:40:39.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770697+0000", 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4590000000000001e-06 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770705+0000", 2023-11-19T00:40:39.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3010000000000007e-06 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770712+0000", 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.759e-06 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770901+0000", 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000189285 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770905+0000", 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8489999999999999e-06 2023-11-19T00:40:39.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778567+0000", 2023-11-19T00:40:39.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076619059999999996 2023-11-19T00:40:39.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778696+0000", 2023-11-19T00:40:39.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012879999999999999 2023-11-19T00:40:39.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2023-11-19T00:40:39.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.778831+0000", 2023-11-19T00:40:39.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135363 2023-11-19T00:40:39.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.780521+0000", 2023-11-19T00:40:39.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00169046 2023-11-19T00:40:39.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787394+0000", 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068729689999999996 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787450+0000", 2023-11-19T00:40:39.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5037999999999997e-05 2023-11-19T00:40:39.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787487+0000", 2023-11-19T00:40:39.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7951000000000003e-05 2023-11-19T00:40:39.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.30615747900001, 2023-11-19T00:40:39.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013321803, 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:39.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770726+0000", 2023-11-19T00:40:39.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1999999999999999e-07 2023-11-19T00:40:39.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770730+0000", 2023-11-19T00:40:39.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7629999999999998e-06 2023-11-19T00:40:39.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770738+0000", 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3810000000000001e-06 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770743+0000", 2023-11-19T00:40:39.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6160000000000001e-06 2023-11-19T00:40:39.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770843+0000", 2023-11-19T00:40:39.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9424000000000002e-05 2023-11-19T00:40:39.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770858+0000", 2023-11-19T00:40:39.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767e-05 2023-11-19T00:40:39.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777700+0000", 2023-11-19T00:40:39.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068419090000000002 2023-11-19T00:40:39.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777813+0000", 2023-11-19T00:40:39.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.777910+0000", 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7016999999999996e-05 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779731+0000", 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001821397 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.783908+0000", 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041771320000000001 2023-11-19T00:40:39.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784004+0000", 2023-11-19T00:40:39.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5508999999999996e-05 2023-11-19T00:40:39.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.784048+0000", 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3971999999999998e-05 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.290 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-11-19T00:40:39.291 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:39.291 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.30609669499999, 2023-11-19T00:40:39.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016830896000000001, 2023-11-19T00:40:39.291 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.291 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2023-11-19T00:40:39.291 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770787+0000", 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.68e-07 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770790+0000", 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.419e-06 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770797+0000", 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8010000000000004e-06 2023-11-19T00:40:39.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.770804+0000", 2023-11-19T00:40:39.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6460000000000004e-06 2023-11-19T00:40:39.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771037+0000", 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023326799999999999 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting_for_map not empty", 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.771050+0000", 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2462e-05 2023-11-19T00:40:39.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779301+0000", 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082516859999999994 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.779424+0000", 2023-11-19T00:40:39.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122371 2023-11-19T00:40:39.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:38:44.787617+0000", 2023-11-19T00:40:39.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0081936749999999992 2023-11-19T00:40:39.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.299 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.299 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(mds.0.3:192 3.1d e44/16 3:bec1251c:::200.00000007:head v 44'6, mlcod=41'4)", 2023-11-19T00:40:39.299 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:39.299 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 31.251492668000001, 2023-11-19T00:40:39.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014848036, 2023-11-19T00:40:39.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2023-11-19T00:40:39.300 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2023-11-19T00:40:39.300 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2023-11-19T00:40:39.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2023-11-19T00:40:39.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:39.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2023-11-19T00:40:39.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:39.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2023-11-19T00:40:39.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2023-11-19T00:40:39.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.825391+0000", 2023-11-19T00:40:39.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9099999999999999e-07 2023-11-19T00:40:39.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2023-11-19T00:40:39.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829269+0000", 2023-11-19T00:40:39.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038783670000000002 2023-11-19T00:40:39.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2023-11-19T00:40:39.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829278+0000", 2023-11-19T00:40:39.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4020000000000002e-06 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829282+0000", 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4950000000000002e-06 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829325+0000", 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2323000000000001e-05 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.829342+0000", 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7144999999999999e-05 2023-11-19T00:40:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840192+0000", 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010850435 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2023-11-19T00:40:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2023-11-19T00:40:07.840239+0000", 2023-11-19T00:40:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6477999999999998e-05 2023-11-19T00:40:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2023-11-19T00:40:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2023-11-19T00:40:39.307 INFO:teuthology.orchestra.run.smithi181.stdout:} 2023-11-19T00:40:40.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-11-19T00:40:40.678 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2023-11-19T00:40:40.693 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-11-19T00:40:41.689 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2023-11-19T00:40:43.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2023-11-19T00:40:43.287 INFO:teuthology.orchestra.run.smithi046.stdout:mon.a: {} 2023-11-19T00:40:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2023-11-19T00:40:43.297 INFO:teuthology.orchestra.run.smithi046.stdout:mon.b: {} 2023-11-19T00:40:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2023-11-19T00:40:43.306 INFO:teuthology.orchestra.run.smithi046.stdout:mon.c: {} 2023-11-19T00:40:43.306 INFO:teuthology.orchestra.run.smithi046.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2023-11-19T00:40:43.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-11-19T00:40:43.688 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.0 to 1 (10000) 2023-11-19T00:40:43.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2023-11-19T00:40:44.699 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.0 primary-affinity to 1 (8655362) 2023-11-19T00:40:44.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-11-19T00:40:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.1 to 1 (10000) 2023-11-19T00:40:45.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2023-11-19T00:40:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.1 primary-affinity to 1 (8655362) 2023-11-19T00:40:46.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-11-19T00:40:47.621 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.2 to 1 (10000) 2023-11-19T00:40:47.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2023-11-19T00:40:48.626 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.2 primary-affinity to 1 (8655362) 2023-11-19T00:40:48.643 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2023-11-19T00:40:48.643 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2023-11-19T00:40:48.643 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2023-11-19T00:40:48.643 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2023-11-19T00:40:48.643 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-19T00:40:48.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:40:48.946 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:48.946 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":73,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:40:48.622375+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.7","osds":[0]},{"pgid":"4.14","osds":[0]},{"pgid":"4.23","osds":[0]},{"pgid":"4.3b","osds":[0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:40:48.959 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-19T00:40:48.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:40:49.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:49.255 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":73,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:40:48.622375+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.7","osds":[0]},{"pgid":"4.14","osds":[0]},{"pgid":"4.23","osds":[0]},{"pgid":"4.3b","osds":[0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:40:49.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-19T00:40:49.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-19T00:40:49.269 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-19T00:40:49.415 INFO:teuthology.orchestra.run.smithi046.stdout:38654705698 2023-11-19T00:40:49.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-19T00:40:49.436 INFO:teuthology.orchestra.run.smithi046.stdout:34359738398 2023-11-19T00:40:49.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-19T00:40:49.438 INFO:teuthology.orchestra.run.smithi046.stdout:34359738400 2023-11-19T00:40:49.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-19T00:40:49.765 INFO:teuthology.orchestra.run.smithi046.stdout:38654705697 2023-11-19T00:40:49.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.0 2023-11-19T00:40:49.786 INFO:teuthology.orchestra.run.smithi046.stdout:34359738397 2023-11-19T00:40:49.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738398 got 34359738397 for osd.1 2023-11-19T00:40:49.825 INFO:teuthology.orchestra.run.smithi046.stdout:34359738399 2023-11-19T00:40:49.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738400 got 34359738399 for osd.2 2023-11-19T00:40:50.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-19T00:40:50.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-19T00:40:50.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-19T00:40:51.123 INFO:teuthology.orchestra.run.smithi046.stdout:38654705697 2023-11-19T00:40:51.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.0 2023-11-19T00:40:51.157 INFO:teuthology.orchestra.run.smithi046.stdout:34359738397 2023-11-19T00:40:51.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738398 got 34359738397 for osd.1 2023-11-19T00:40:51.178 INFO:teuthology.orchestra.run.smithi046.stdout:34359738399 2023-11-19T00:40:51.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738400 got 34359738399 for osd.2 2023-11-19T00:40:52.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-19T00:40:52.171 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-19T00:40:52.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-19T00:40:52.462 INFO:teuthology.orchestra.run.smithi046.stdout:38654705698 2023-11-19T00:40:52.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705698 for osd.0 2023-11-19T00:40:52.475 DEBUG:teuthology.parallel:result is None 2023-11-19T00:40:52.520 INFO:teuthology.orchestra.run.smithi046.stdout:34359738398 2023-11-19T00:40:52.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738398 got 34359738398 for osd.1 2023-11-19T00:40:52.533 DEBUG:teuthology.parallel:result is None 2023-11-19T00:40:52.554 INFO:teuthology.orchestra.run.smithi046.stdout:34359738400 2023-11-19T00:40:52.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738400 got 34359738400 for osd.2 2023-11-19T00:40:52.567 DEBUG:teuthology.parallel:result is None 2023-11-19T00:40:52.567 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-11-19T00:40:52.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:40:52.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:52.909 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:40:52.919 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2023-11-19T00:40:51.046550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67851131,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":321,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11024,"num_write_kb":82482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4991,"num_bytes_recovered":41323729,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10820,"ondisk_log_size":10820,"up":210,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":325680,"kb_used_data":169656,"kb_used_omap":4,"kb_used_meta":155963,"kb_avail":282789840,"statfs":{"total":289910292480,"available":289576796160,"internally_reserved":0,"allocated":173727744,"data_stored":150121013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":159706447},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":109408,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":-306,"num_objects_misplaced":-326,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1640,"num_bytes_recovered":16725987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000786"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":448,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.647180+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:47.647180+0000","last_peered":"2023-11-19T00:40:47.647180+0000","last_clean":"2023-11-19T00:40:47.647180+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:47.647180+0000","last_undegraded":"2023-11-19T00:40:47.647180+0000","last_fullsized":"2023-11-19T00:40:47.647180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":223,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627554+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:48.627554+0000","last_peered":"2023-11-19T00:40:48.627554+0000","last_clean":"2023-11-19T00:40:48.627554+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:48.627554+0000","last_undegraded":"2023-11-19T00:40:48.627554+0000","last_fullsized":"2023-11-19T00:40:48.627554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":231,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.628974+0000","last_change":"2023-11-19T00:40:48.628974+0000","last_active":"2023-11-19T00:40:48.628974+0000","last_peered":"2023-11-19T00:40:45.707629+0000","last_clean":"2023-11-19T00:40:45.707629+0000","last_became_active":"2023-11-19T00:38:44.779698+0000","last_became_peered":"2023-11-19T00:38:44.779698+0000","last_unstale":"2023-11-19T00:40:48.628974+0000","last_undegraded":"2023-11-19T00:40:48.628974+0000","last_fullsized":"2023-11-19T00:40:48.628974+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":161,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.631889+0000","last_change":"2023-11-19T00:40:48.631889+0000","last_active":"2023-11-19T00:40:48.631889+0000","last_peered":"2023-11-19T00:40:23.621358+0000","last_clean":"2023-11-19T00:40:23.621358+0000","last_became_active":"2023-11-19T00:38:44.783003+0000","last_became_peered":"2023-11-19T00:38:44.783003+0000","last_unstale":"2023-11-19T00:40:48.631889+0000","last_undegraded":"2023-11-19T00:40:48.631889+0000","last_fullsized":"2023-11-19T00:40:48.631889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":724,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:48.772501+0000","last_change":"2023-11-19T00:40:48.772670+0000","last_active":"2023-11-19T00:40:48.772501+0000","last_peered":"2023-11-19T00:40:48.772501+0000","last_clean":"2023-11-19T00:40:44.699213+0000","last_became_active":"2023-11-19T00:40:47.637744+0000","last_became_peered":"2023-11-19T00:40:47.637744+0000","last_unstale":"2023-11-19T00:40:48.772501+0000","last_undegraded":"2023-11-19T00:40:48.772501+0000","last_fullsized":"2023-11-19T00:40:47.621066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":65}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":435,"reported_epoch":70,"state":"active+remapped","last_fresh":"2023-11-19T00:40:45.974253+0000","last_change":"2023-11-19T00:40:45.974253+0000","last_active":"2023-11-19T00:40:45.974253+0000","last_peered":"2023-11-19T00:40:45.974253+0000","last_clean":"2023-11-19T00:40:25.684009+0000","last_became_active":"2023-11-19T00:40:45.717684+0000","last_became_peered":"2023-11-19T00:40:45.717684+0000","last_unstale":"2023-11-19T00:40:45.974253+0000","last_undegraded":"2023-11-19T00:40:45.974253+0000","last_fullsized":"2023-11-19T00:40:45.974253+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:34:02.002331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[1,2],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1,2","objects":55}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":228,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680279+0000","last_change":"2023-11-19T00:40:25.679741+0000","last_active":"2023-11-19T00:40:40.680279+0000","last_peered":"2023-11-19T00:40:40.680279+0000","last_clean":"2023-11-19T00:40:40.680279+0000","last_became_active":"2023-11-19T00:40:25.678717+0000","last_became_peered":"2023-11-19T00:40:25.678717+0000","last_unstale":"2023-11-19T00:40:40.680279+0000","last_undegraded":"2023-11-19T00:40:40.680279+0000","last_fullsized":"2023-11-19T00:40:40.680279+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:39:51.168717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":180,"reported_epoch":70,"state":"active+recovery_wait+remapped","last_fresh":"2023-11-19T00:40:45.724934+0000","last_change":"2023-11-19T00:40:45.724934+0000","last_active":"2023-11-19T00:40:45.724934+0000","last_peered":"2023-11-19T00:40:45.724934+0000","last_clean":"2023-11-19T00:40:23.620353+0000","last_became_active":"2023-11-19T00:40:45.723615+0000","last_became_peered":"2023-11-19T00:40:45.723615+0000","last_unstale":"2023-11-19T00:40:45.724934+0000","last_undegraded":"2023-11-19T00:40:45.724934+0000","last_fullsized":"2023-11-19T00:40:45.724934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:09:43.451489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":84,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":234,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.621993+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:47.621993+0000","last_peered":"2023-11-19T00:40:47.621993+0000","last_clean":"2023-11-19T00:40:47.621993+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:47.621993+0000","last_undegraded":"2023-11-19T00:40:47.621993+0000","last_fullsized":"2023-11-19T00:40:47.621993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":402,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:47.879075+0000","last_change":"2023-11-19T00:40:49.423952+0000","last_active":"2023-11-19T00:40:49.423952+0000","last_peered":"2023-11-19T00:40:47.879075+0000","last_clean":"2023-11-19T00:40:32.521539+0000","last_became_active":"2023-11-19T00:40:47.637283+0000","last_became_peered":"2023-11-19T00:40:47.637283+0000","last_unstale":"2023-11-19T00:40:47.879075+0000","last_undegraded":"2023-11-19T00:40:47.879075+0000","last_fullsized":"2023-11-19T00:40:47.621557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":431,"reported_epoch":70,"state":"active+remapped","last_fresh":"2023-11-19T00:40:46.100501+0000","last_change":"2023-11-19T00:40:46.100501+0000","last_active":"2023-11-19T00:40:46.100501+0000","last_peered":"2023-11-19T00:40:46.100501+0000","last_clean":"2023-11-19T00:40:25.629407+0000","last_became_active":"2023-11-19T00:40:45.719146+0000","last_became_peered":"2023-11-19T00:40:45.719146+0000","last_unstale":"2023-11-19T00:40:46.100501+0000","last_undegraded":"2023-11-19T00:40:46.100501+0000","last_fullsized":"2023-11-19T00:40:46.100501+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:58:19.770374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[1,2],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1,2","objects":56}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":208,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.634865+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:47.634865+0000","last_peered":"2023-11-19T00:40:47.634865+0000","last_clean":"2023-11-19T00:40:47.634865+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:47.634865+0000","last_undegraded":"2023-11-19T00:40:47.634865+0000","last_fullsized":"2023-11-19T00:40:47.634865+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":569,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.644106+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:47.644106+0000","last_peered":"2023-11-19T00:40:47.644106+0000","last_clean":"2023-11-19T00:40:47.644106+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:47.644106+0000","last_undegraded":"2023-11-19T00:40:47.644106+0000","last_fullsized":"2023-11-19T00:40:47.644106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":660,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:48.005634+0000","last_change":"2023-11-19T00:40:48.628365+0000","last_active":"2023-11-19T00:40:48.628365+0000","last_peered":"2023-11-19T00:40:48.005634+0000","last_clean":"2023-11-19T00:40:23.620640+0000","last_became_active":"2023-11-19T00:40:47.642933+0000","last_became_peered":"2023-11-19T00:40:47.642933+0000","last_unstale":"2023-11-19T00:40:48.005634+0000","last_undegraded":"2023-11-19T00:40:48.005634+0000","last_fullsized":"2023-11-19T00:40:47.621583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":218,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.707318+0000","last_change":"2023-11-19T00:40:48.628642+0000","last_active":"2023-11-19T00:40:48.628642+0000","last_peered":"2023-11-19T00:40:45.707318+0000","last_clean":"2023-11-19T00:40:45.707318+0000","last_became_active":"2023-11-19T00:38:44.779066+0000","last_became_peered":"2023-11-19T00:38:44.779066+0000","last_unstale":"2023-11-19T00:40:45.707318+0000","last_undegraded":"2023-11-19T00:40:45.707318+0000","last_fullsized":"2023-11-19T00:40:45.707318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":239,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680314+0000","last_change":"2023-11-19T00:40:02.776922+0000","last_active":"2023-11-19T00:40:40.680314+0000","last_peered":"2023-11-19T00:40:40.680314+0000","last_clean":"2023-11-19T00:40:40.680314+0000","last_became_active":"2023-11-19T00:40:02.775912+0000","last_became_peered":"2023-11-19T00:40:02.775912+0000","last_unstale":"2023-11-19T00:40:40.680314+0000","last_undegraded":"2023-11-19T00:40:40.680314+0000","last_fullsized":"2023-11-19T00:40:40.680314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:27:00.142752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":219,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622954+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:47.622954+0000","last_peered":"2023-11-19T00:40:47.622954+0000","last_clean":"2023-11-19T00:40:47.622954+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:47.622954+0000","last_undegraded":"2023-11-19T00:40:47.622954+0000","last_fullsized":"2023-11-19T00:40:47.622954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":424,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627710+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:48.627710+0000","last_peered":"2023-11-19T00:40:48.627710+0000","last_clean":"2023-11-19T00:40:48.627710+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:48.627710+0000","last_undegraded":"2023-11-19T00:40:48.627710+0000","last_fullsized":"2023-11-19T00:40:48.627710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":414,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.625991+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:48.625991+0000","last_peered":"2023-11-19T00:40:48.625991+0000","last_clean":"2023-11-19T00:40:48.625991+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:48.625991+0000","last_undegraded":"2023-11-19T00:40:48.625991+0000","last_fullsized":"2023-11-19T00:40:48.625991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":228,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680889+0000","last_change":"2023-11-19T00:40:25.683948+0000","last_active":"2023-11-19T00:40:40.680889+0000","last_peered":"2023-11-19T00:40:40.680889+0000","last_clean":"2023-11-19T00:40:40.680889+0000","last_became_active":"2023-11-19T00:40:25.681705+0000","last_became_peered":"2023-11-19T00:40:25.681705+0000","last_unstale":"2023-11-19T00:40:40.680889+0000","last_undegraded":"2023-11-19T00:40:40.680889+0000","last_fullsized":"2023-11-19T00:40:40.680889+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:48:19.411040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":222,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.681068+0000","last_change":"2023-11-19T00:40:25.685372+0000","last_active":"2023-11-19T00:40:40.681068+0000","last_peered":"2023-11-19T00:40:40.681068+0000","last_clean":"2023-11-19T00:40:40.681068+0000","last_became_active":"2023-11-19T00:40:25.683854+0000","last_became_peered":"2023-11-19T00:40:25.683854+0000","last_unstale":"2023-11-19T00:40:40.681068+0000","last_undegraded":"2023-11-19T00:40:40.681068+0000","last_fullsized":"2023-11-19T00:40:40.681068+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:30:00.980843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":231,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.633104+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:47.633104+0000","last_peered":"2023-11-19T00:40:47.633104+0000","last_clean":"2023-11-19T00:40:47.633104+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:47.633104+0000","last_undegraded":"2023-11-19T00:40:47.633104+0000","last_fullsized":"2023-11-19T00:40:47.633104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":216,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.620799+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:47.620799+0000","last_peered":"2023-11-19T00:40:47.620799+0000","last_clean":"2023-11-19T00:40:47.620799+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:47.620799+0000","last_undegraded":"2023-11-19T00:40:47.620799+0000","last_fullsized":"2023-11-19T00:40:47.620799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":214,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.646276+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:47.646276+0000","last_peered":"2023-11-19T00:40:47.646276+0000","last_clean":"2023-11-19T00:40:47.646276+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:47.646276+0000","last_undegraded":"2023-11-19T00:40:47.646276+0000","last_fullsized":"2023-11-19T00:40:47.646276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":246,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.631771+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:47.631771+0000","last_peered":"2023-11-19T00:40:47.631771+0000","last_clean":"2023-11-19T00:40:47.631771+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:47.631771+0000","last_undegraded":"2023-11-19T00:40:47.631771+0000","last_fullsized":"2023-11-19T00:40:47.631771+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":250,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623132+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:47.623132+0000","last_peered":"2023-11-19T00:40:47.623132+0000","last_clean":"2023-11-19T00:40:47.623132+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:47.623132+0000","last_undegraded":"2023-11-19T00:40:47.623132+0000","last_fullsized":"2023-11-19T00:40:47.623132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":210,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.707785+0000","last_change":"2023-11-19T00:40:48.633998+0000","last_active":"2023-11-19T00:40:48.633998+0000","last_peered":"2023-11-19T00:40:45.707785+0000","last_clean":"2023-11-19T00:40:45.707785+0000","last_became_active":"2023-11-19T00:38:44.780514+0000","last_became_peered":"2023-11-19T00:38:44.780514+0000","last_unstale":"2023-11-19T00:40:45.707785+0000","last_undegraded":"2023-11-19T00:40:45.707785+0000","last_fullsized":"2023-11-19T00:40:45.707785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":233,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.634677+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:47.634677+0000","last_peered":"2023-11-19T00:40:47.634677+0000","last_clean":"2023-11-19T00:40:47.634677+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:47.634677+0000","last_undegraded":"2023-11-19T00:40:47.634677+0000","last_fullsized":"2023-11-19T00:40:47.634677+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":658,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:48.909981+0000","last_change":"2023-11-19T00:40:48.910157+0000","last_active":"2023-11-19T00:40:48.909981+0000","last_peered":"2023-11-19T00:40:48.909981+0000","last_clean":"2023-11-19T00:40:27.631223+0000","last_became_active":"2023-11-19T00:40:47.638423+0000","last_became_peered":"2023-11-19T00:40:47.638423+0000","last_unstale":"2023-11-19T00:40:48.909981+0000","last_undegraded":"2023-11-19T00:40:48.909981+0000","last_fullsized":"2023-11-19T00:40:47.622411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:17.209630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":64}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":264,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.633309+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:47.633309+0000","last_peered":"2023-11-19T00:40:47.633309+0000","last_clean":"2023-11-19T00:40:47.633309+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:47.633309+0000","last_undegraded":"2023-11-19T00:40:47.633309+0000","last_fullsized":"2023-11-19T00:40:47.633309+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":760,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:48.144582+0000","last_change":"2023-11-19T00:40:48.629951+0000","last_active":"2023-11-19T00:40:48.629951+0000","last_peered":"2023-11-19T00:40:48.144582+0000","last_clean":"2023-11-19T00:40:44.698753+0000","last_became_active":"2023-11-19T00:40:47.637260+0000","last_became_peered":"2023-11-19T00:40:47.637260+0000","last_unstale":"2023-11-19T00:40:48.144582+0000","last_undegraded":"2023-11-19T00:40:48.144582+0000","last_fullsized":"2023-11-19T00:40:47.620927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":223,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.633153+0000","last_change":"2023-11-19T00:40:48.633153+0000","last_active":"2023-11-19T00:40:48.633153+0000","last_peered":"2023-11-19T00:40:23.620553+0000","last_clean":"2023-11-19T00:40:23.620553+0000","last_became_active":"2023-11-19T00:38:44.783847+0000","last_became_peered":"2023-11-19T00:38:44.783847+0000","last_unstale":"2023-11-19T00:40:48.633153+0000","last_undegraded":"2023-11-19T00:40:48.633153+0000","last_fullsized":"2023-11-19T00:40:48.633153+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":578,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:49.021847+0000","last_change":"2023-11-19T00:40:49.022028+0000","last_active":"2023-11-19T00:40:49.021847+0000","last_peered":"2023-11-19T00:40:49.021847+0000","last_clean":"2023-11-19T00:40:32.516625+0000","last_became_active":"2023-11-19T00:40:47.645959+0000","last_became_peered":"2023-11-19T00:40:47.645959+0000","last_unstale":"2023-11-19T00:40:49.021847+0000","last_undegraded":"2023-11-19T00:40:49.021847+0000","last_fullsized":"2023-11-19T00:40:47.625184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":51}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"69'137","reported_seq":202,"reported_epoch":69,"state":"peering","last_fresh":"2023-11-19T00:40:44.853548+0000","last_change":"2023-11-19T00:40:48.628474+0000","last_active":"2023-11-19T00:40:48.628474+0000","last_peered":"2023-11-19T00:40:44.853548+0000","last_clean":"2023-11-19T00:40:44.853548+0000","last_became_active":"2023-11-19T00:40:25.683164+0000","last_became_peered":"2023-11-19T00:40:25.683164+0000","last_unstale":"2023-11-19T00:40:44.853548+0000","last_undegraded":"2023-11-19T00:40:44.853548+0000","last_fullsized":"2023-11-19T00:40:44.853548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2979871,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":2984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":463,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.243162+0000","last_change":"2023-11-19T00:40:49.423922+0000","last_active":"2023-11-19T00:40:49.423922+0000","last_peered":"2023-11-19T00:40:48.243162+0000","last_clean":"2023-11-19T00:40:44.700963+0000","last_became_active":"2023-11-19T00:40:47.637530+0000","last_became_peered":"2023-11-19T00:40:47.637530+0000","last_unstale":"2023-11-19T00:40:48.243162+0000","last_undegraded":"2023-11-19T00:40:48.243162+0000","last_fullsized":"2023-11-19T00:40:47.622215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.624252+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:47.624252+0000","last_peered":"2023-11-19T00:40:47.624252+0000","last_clean":"2023-11-19T00:40:47.624252+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:47.624252+0000","last_undegraded":"2023-11-19T00:40:47.624252+0000","last_fullsized":"2023-11-19T00:40:47.624252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":238,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623497+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:47.623497+0000","last_peered":"2023-11-19T00:40:47.623497+0000","last_clean":"2023-11-19T00:40:47.623497+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:47.623497+0000","last_undegraded":"2023-11-19T00:40:47.623497+0000","last_fullsized":"2023-11-19T00:40:47.623497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.626664+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:47.626664+0000","last_peered":"2023-11-19T00:40:47.626664+0000","last_clean":"2023-11-19T00:40:47.626664+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:47.626664+0000","last_undegraded":"2023-11-19T00:40:47.626664+0000","last_fullsized":"2023-11-19T00:40:47.626664+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":207,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.629142+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:48.629142+0000","last_peered":"2023-11-19T00:40:48.629142+0000","last_clean":"2023-11-19T00:40:48.629142+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:48.629142+0000","last_undegraded":"2023-11-19T00:40:48.629142+0000","last_fullsized":"2023-11-19T00:40:48.629142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":89,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.705818+0000","last_change":"2023-11-19T00:40:45.705818+0000","last_active":"2023-11-19T00:40:43.694974+0000","last_peered":"2023-11-19T00:40:41.971331+0000","last_clean":"2023-11-19T00:40:41.971331+0000","last_became_active":"2023-11-19T00:40:34.673487+0000","last_became_peered":"2023-11-19T00:40:34.673487+0000","last_unstale":"2023-11-19T00:40:45.705818+0000","last_undegraded":"2023-11-19T00:40:45.705818+0000","last_fullsized":"2023-11-19T00:40:45.705818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":76,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.708786+0000","last_change":"2023-11-19T00:40:45.708786+0000","last_active":"2023-11-19T00:40:43.696461+0000","last_peered":"2023-11-19T00:40:41.972565+0000","last_clean":"2023-11-19T00:40:41.972565+0000","last_became_active":"2023-11-19T00:40:34.673301+0000","last_became_peered":"2023-11-19T00:40:34.673301+0000","last_unstale":"2023-11-19T00:40:45.708786+0000","last_undegraded":"2023-11-19T00:40:45.708786+0000","last_fullsized":"2023-11-19T00:40:45.708786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":234,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.631060+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:47.631060+0000","last_peered":"2023-11-19T00:40:47.631060+0000","last_clean":"2023-11-19T00:40:47.631060+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:47.631060+0000","last_undegraded":"2023-11-19T00:40:47.631060+0000","last_fullsized":"2023-11-19T00:40:47.631060+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.628234+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:47.628234+0000","last_peered":"2023-11-19T00:40:47.628234+0000","last_clean":"2023-11-19T00:40:47.628234+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:47.628234+0000","last_undegraded":"2023-11-19T00:40:47.628234+0000","last_fullsized":"2023-11-19T00:40:47.628234+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":469,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.625509+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:48.625509+0000","last_peered":"2023-11-19T00:40:48.625509+0000","last_clean":"2023-11-19T00:40:48.625509+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:48.625509+0000","last_undegraded":"2023-11-19T00:40:48.625509+0000","last_fullsized":"2023-11-19T00:40:48.625509+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":66,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.708918+0000","last_change":"2023-11-19T00:40:48.635690+0000","last_active":"2023-11-19T00:40:48.635690+0000","last_peered":"2023-11-19T00:40:45.708918+0000","last_clean":"2023-11-19T00:40:45.708918+0000","last_became_active":"2023-11-19T00:40:13.813550+0000","last_became_peered":"2023-11-19T00:40:13.813550+0000","last_unstale":"2023-11-19T00:40:45.708918+0000","last_undegraded":"2023-11-19T00:40:45.708918+0000","last_fullsized":"2023-11-19T00:40:45.708918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":396,"reported_epoch":70,"state":"active+remapped","last_fresh":"2023-11-19T00:40:46.321988+0000","last_change":"2023-11-19T00:40:46.321988+0000","last_active":"2023-11-19T00:40:46.321988+0000","last_peered":"2023-11-19T00:40:46.321988+0000","last_clean":"2023-11-19T00:40:23.620736+0000","last_became_active":"2023-11-19T00:40:45.720555+0000","last_became_peered":"2023-11-19T00:40:45.720555+0000","last_unstale":"2023-11-19T00:40:46.321988+0000","last_undegraded":"2023-11-19T00:40:46.321988+0000","last_fullsized":"2023-11-19T00:40:46.321988+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:08.645789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[1,2],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1,2","objects":56}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.681018+0000","last_change":"2023-11-19T00:40:25.684354+0000","last_active":"2023-11-19T00:40:40.681018+0000","last_peered":"2023-11-19T00:40:40.681018+0000","last_clean":"2023-11-19T00:40:40.681018+0000","last_became_active":"2023-11-19T00:40:25.683161+0000","last_became_peered":"2023-11-19T00:40:25.683161+0000","last_unstale":"2023-11-19T00:40:40.681018+0000","last_undegraded":"2023-11-19T00:40:40.681018+0000","last_fullsized":"2023-11-19T00:40:40.681018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:43:24.454729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":225,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.621694+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:47.621694+0000","last_peered":"2023-11-19T00:40:47.621694+0000","last_clean":"2023-11-19T00:40:47.621694+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:47.621694+0000","last_undegraded":"2023-11-19T00:40:47.621694+0000","last_fullsized":"2023-11-19T00:40:47.621694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627716+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:48.627716+0000","last_peered":"2023-11-19T00:40:48.627716+0000","last_clean":"2023-11-19T00:40:48.627716+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:48.627716+0000","last_undegraded":"2023-11-19T00:40:48.627716+0000","last_fullsized":"2023-11-19T00:40:48.627716+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":226,"reported_epoch":70,"state":"active+recovery_wait+remapped","last_fresh":"2023-11-19T00:40:45.723976+0000","last_change":"2023-11-19T00:40:45.723976+0000","last_active":"2023-11-19T00:40:45.723976+0000","last_peered":"2023-11-19T00:40:45.723976+0000","last_clean":"2023-11-19T00:40:23.621522+0000","last_became_active":"2023-11-19T00:40:45.723051+0000","last_became_peered":"2023-11-19T00:40:45.723051+0000","last_unstale":"2023-11-19T00:40:45.723976+0000","last_undegraded":"2023-11-19T00:40:45.723976+0000","last_fullsized":"2023-11-19T00:40:45.723976+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:21:16.056247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":115,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":63}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680619+0000","last_change":"2023-11-19T00:40:25.684235+0000","last_active":"2023-11-19T00:40:40.680619+0000","last_peered":"2023-11-19T00:40:40.680619+0000","last_clean":"2023-11-19T00:40:40.680619+0000","last_became_active":"2023-11-19T00:40:25.682038+0000","last_became_peered":"2023-11-19T00:40:25.682038+0000","last_unstale":"2023-11-19T00:40:40.680619+0000","last_undegraded":"2023-11-19T00:40:40.680619+0000","last_fullsized":"2023-11-19T00:40:40.680619+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:24:25.523135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":222,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.708641+0000","last_change":"2023-11-19T00:40:48.634974+0000","last_active":"2023-11-19T00:40:48.634974+0000","last_peered":"2023-11-19T00:40:45.708641+0000","last_clean":"2023-11-19T00:40:45.708641+0000","last_became_active":"2023-11-19T00:38:44.780831+0000","last_became_peered":"2023-11-19T00:38:44.780831+0000","last_unstale":"2023-11-19T00:40:45.708641+0000","last_undegraded":"2023-11-19T00:40:45.708641+0000","last_fullsized":"2023-11-19T00:40:45.708641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":65,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.626884+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:47.626884+0000","last_peered":"2023-11-19T00:40:47.626884+0000","last_clean":"2023-11-19T00:40:47.626884+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:47.626884+0000","last_undegraded":"2023-11-19T00:40:47.626884+0000","last_fullsized":"2023-11-19T00:40:47.626884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":563,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:47.762960+0000","last_change":"2023-11-19T00:40:48.628913+0000","last_active":"2023-11-19T00:40:48.628913+0000","last_peered":"2023-11-19T00:40:47.762960+0000","last_clean":"2023-11-19T00:40:23.621607+0000","last_became_active":"2023-11-19T00:40:47.637637+0000","last_became_peered":"2023-11-19T00:40:47.637637+0000","last_unstale":"2023-11-19T00:40:47.762960+0000","last_undegraded":"2023-11-19T00:40:47.762960+0000","last_fullsized":"2023-11-19T00:40:47.621816+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":44,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626689+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:48.626689+0000","last_peered":"2023-11-19T00:40:48.626689+0000","last_clean":"2023-11-19T00:40:48.626689+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:48.626689+0000","last_undegraded":"2023-11-19T00:40:48.626689+0000","last_fullsized":"2023-11-19T00:40:48.626689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":205,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622080+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:47.622080+0000","last_peered":"2023-11-19T00:40:47.622080+0000","last_clean":"2023-11-19T00:40:47.622080+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:47.622080+0000","last_undegraded":"2023-11-19T00:40:47.622080+0000","last_fullsized":"2023-11-19T00:40:47.622080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":297,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.708510+0000","last_change":"2023-11-19T00:40:48.627946+0000","last_active":"2023-11-19T00:40:48.627946+0000","last_peered":"2023-11-19T00:40:45.708510+0000","last_clean":"2023-11-19T00:40:45.708510+0000","last_became_active":"2023-11-19T00:40:37.682940+0000","last_became_peered":"2023-11-19T00:40:37.682940+0000","last_unstale":"2023-11-19T00:40:45.708510+0000","last_undegraded":"2023-11-19T00:40:45.708510+0000","last_fullsized":"2023-11-19T00:40:45.708510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.632730+0000","last_change":"2023-11-19T00:40:24.638859+0000","last_active":"2023-11-19T00:38:38.737291+0000","last_peered":"2023-11-19T00:38:38.737291+0000","last_clean":"2023-11-19T00:38:38.737291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:40:48.632730+0000","last_undegraded":"2023-11-19T00:40:48.632730+0000","last_fullsized":"2023-11-19T00:40:48.632730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":55,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.707013+0000","last_change":"2023-11-19T00:40:48.633098+0000","last_active":"2023-11-19T00:40:48.633098+0000","last_peered":"2023-11-19T00:40:45.707013+0000","last_clean":"2023-11-19T00:40:45.707013+0000","last_became_active":"2023-11-19T00:39:20.675075+0000","last_became_peered":"2023-11-19T00:39:20.675075+0000","last_unstale":"2023-11-19T00:40:45.707013+0000","last_undegraded":"2023-11-19T00:40:45.707013+0000","last_fullsized":"2023-11-19T00:40:45.707013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":417,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.708727+0000","last_change":"2023-11-19T00:40:48.634036+0000","last_active":"2023-11-19T00:40:48.634036+0000","last_peered":"2023-11-19T00:40:45.708727+0000","last_clean":"2023-11-19T00:40:45.708727+0000","last_became_active":"2023-11-19T00:40:34.676732+0000","last_became_peered":"2023-11-19T00:40:34.676732+0000","last_unstale":"2023-11-19T00:40:45.708727+0000","last_undegraded":"2023-11-19T00:40:45.708727+0000","last_fullsized":"2023-11-19T00:40:45.708727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:47.628068+0000","last_change":"2023-11-19T00:40:18.822467+0000","last_active":"2023-11-19T00:40:18.822467+0000","last_peered":"2023-11-19T00:40:15.811776+0000","last_clean":"2023-11-19T00:40:15.811776+0000","last_became_active":"2023-11-19T00:38:39.747697+0000","last_became_peered":"2023-11-19T00:38:39.747697+0000","last_unstale":"2023-11-19T00:40:47.628068+0000","last_undegraded":"2023-11-19T00:40:47.628068+0000","last_fullsized":"2023-11-19T00:40:47.628068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":134,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626547+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:48.626547+0000","last_peered":"2023-11-19T00:40:48.626547+0000","last_clean":"2023-11-19T00:40:48.626547+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:48.626547+0000","last_undegraded":"2023-11-19T00:40:48.626547+0000","last_fullsized":"2023-11-19T00:40:48.626547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":651,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.643696+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:47.643696+0000","last_peered":"2023-11-19T00:40:47.643696+0000","last_clean":"2023-11-19T00:40:47.643696+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:47.643696+0000","last_undegraded":"2023-11-19T00:40:47.643696+0000","last_fullsized":"2023-11-19T00:40:47.643696+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626686+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:48.626686+0000","last_peered":"2023-11-19T00:40:48.626686+0000","last_clean":"2023-11-19T00:40:48.626686+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:48.626686+0000","last_undegraded":"2023-11-19T00:40:48.626686+0000","last_fullsized":"2023-11-19T00:40:48.626686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":130,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.633133+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:47.633133+0000","last_peered":"2023-11-19T00:40:47.633133+0000","last_clean":"2023-11-19T00:40:47.633133+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:47.633133+0000","last_undegraded":"2023-11-19T00:40:47.633133+0000","last_fullsized":"2023-11-19T00:40:47.633133+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":669,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:48.638425+0000","last_change":"2023-11-19T00:40:48.638583+0000","last_active":"2023-11-19T00:40:48.638425+0000","last_peered":"2023-11-19T00:40:48.638425+0000","last_clean":"2023-11-19T00:40:32.513875+0000","last_became_active":"2023-11-19T00:40:47.637497+0000","last_became_peered":"2023-11-19T00:40:47.637497+0000","last_unstale":"2023-11-19T00:40:48.638425+0000","last_undegraded":"2023-11-19T00:40:48.638425+0000","last_fullsized":"2023-11-19T00:40:47.622233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:49.502796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":61}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.635742+0000","last_change":"2023-11-19T00:40:24.637400+0000","last_active":"2023-11-19T00:38:38.737291+0000","last_peered":"2023-11-19T00:38:38.737291+0000","last_clean":"2023-11-19T00:38:38.737291+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:40:48.635742+0000","last_undegraded":"2023-11-19T00:40:48.635742+0000","last_fullsized":"2023-11-19T00:40:48.635742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680807+0000","last_change":"2023-11-19T00:40:25.685250+0000","last_active":"2023-11-19T00:40:40.680807+0000","last_peered":"2023-11-19T00:40:40.680807+0000","last_clean":"2023-11-19T00:40:40.680807+0000","last_became_active":"2023-11-19T00:40:25.683498+0000","last_became_peered":"2023-11-19T00:40:25.683498+0000","last_unstale":"2023-11-19T00:40:40.680807+0000","last_undegraded":"2023-11-19T00:40:40.680807+0000","last_fullsized":"2023-11-19T00:40:40.680807+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":453,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.632364+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:48.632364+0000","last_peered":"2023-11-19T00:40:48.632364+0000","last_clean":"2023-11-19T00:40:48.632364+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:48.632364+0000","last_undegraded":"2023-11-19T00:40:48.632364+0000","last_fullsized":"2023-11-19T00:40:48.632364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680865+0000","last_change":"2023-11-19T00:40:25.677646+0000","last_active":"2023-11-19T00:40:40.680865+0000","last_peered":"2023-11-19T00:40:40.680865+0000","last_clean":"2023-11-19T00:40:40.680865+0000","last_became_active":"2023-11-19T00:40:25.677458+0000","last_became_peered":"2023-11-19T00:40:25.677458+0000","last_unstale":"2023-11-19T00:40:40.680865+0000","last_undegraded":"2023-11-19T00:40:40.680865+0000","last_fullsized":"2023-11-19T00:40:40.680865+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:56.305654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.630059+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:48.630059+0000","last_peered":"2023-11-19T00:40:48.630059+0000","last_clean":"2023-11-19T00:40:48.630059+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:48.630059+0000","last_undegraded":"2023-11-19T00:40:48.630059+0000","last_fullsized":"2023-11-19T00:40:48.630059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":232,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.626318+0000","last_change":"2023-11-19T00:40:48.626318+0000","last_active":"2023-11-19T00:40:46.706914+0000","last_peered":"2023-11-19T00:40:44.699992+0000","last_clean":"2023-11-19T00:40:44.699992+0000","last_became_active":"2023-11-19T00:40:25.679242+0000","last_became_peered":"2023-11-19T00:40:25.679242+0000","last_unstale":"2023-11-19T00:40:48.626318+0000","last_undegraded":"2023-11-19T00:40:48.626318+0000","last_fullsized":"2023-11-19T00:40:48.626318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626047+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:48.626047+0000","last_peered":"2023-11-19T00:40:48.626047+0000","last_clean":"2023-11-19T00:40:48.626047+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:48.626047+0000","last_undegraded":"2023-11-19T00:40:48.626047+0000","last_fullsized":"2023-11-19T00:40:48.626047+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.646312+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:47.646312+0000","last_peered":"2023-11-19T00:40:47.646312+0000","last_clean":"2023-11-19T00:40:47.646312+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:47.646312+0000","last_undegraded":"2023-11-19T00:40:47.646312+0000","last_fullsized":"2023-11-19T00:40:47.646312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":246,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.625175+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:47.625175+0000","last_peered":"2023-11-19T00:40:47.625175+0000","last_clean":"2023-11-19T00:40:47.625175+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:47.625175+0000","last_undegraded":"2023-11-19T00:40:47.625175+0000","last_fullsized":"2023-11-19T00:40:47.625175+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623294+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:47.623294+0000","last_peered":"2023-11-19T00:40:47.623294+0000","last_clean":"2023-11-19T00:40:47.623294+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:47.623294+0000","last_undegraded":"2023-11-19T00:40:47.623294+0000","last_fullsized":"2023-11-19T00:40:47.623294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626266+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:48.626266+0000","last_peered":"2023-11-19T00:40:48.626266+0000","last_clean":"2023-11-19T00:40:48.626266+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:48.626266+0000","last_undegraded":"2023-11-19T00:40:48.626266+0000","last_fullsized":"2023-11-19T00:40:48.626266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":221,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.637978+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:48.637978+0000","last_peered":"2023-11-19T00:40:48.637978+0000","last_clean":"2023-11-19T00:40:48.637978+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:48.637978+0000","last_undegraded":"2023-11-19T00:40:48.637978+0000","last_fullsized":"2023-11-19T00:40:48.637978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.628812+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:48.628812+0000","last_peered":"2023-11-19T00:40:48.628812+0000","last_clean":"2023-11-19T00:40:48.628812+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:48.628812+0000","last_undegraded":"2023-11-19T00:40:48.628812+0000","last_fullsized":"2023-11-19T00:40:48.628812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":73,"state":"peering","last_fresh":"2023-11-19T00:40:48.628796+0000","last_change":"2023-11-19T00:40:47.624152+0000","last_active":"2023-11-19T00:40:47.624152+0000","last_peered":"2023-11-19T00:40:44.700438+0000","last_clean":"2023-11-19T00:40:44.700438+0000","last_became_active":"2023-11-19T00:40:25.678171+0000","last_became_peered":"2023-11-19T00:40:25.678171+0000","last_unstale":"2023-11-19T00:40:48.628796+0000","last_undegraded":"2023-11-19T00:40:48.628796+0000","last_fullsized":"2023-11-19T00:40:48.628796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":220,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.625047+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:47.625047+0000","last_peered":"2023-11-19T00:40:47.625047+0000","last_clean":"2023-11-19T00:40:47.625047+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:47.625047+0000","last_undegraded":"2023-11-19T00:40:47.625047+0000","last_fullsized":"2023-11-19T00:40:47.625047+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":448,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.708044+0000","last_change":"2023-11-19T00:40:48.628141+0000","last_active":"2023-11-19T00:40:48.628141+0000","last_peered":"2023-11-19T00:40:45.708044+0000","last_clean":"2023-11-19T00:40:45.708044+0000","last_became_active":"2023-11-19T00:40:34.670128+0000","last_became_peered":"2023-11-19T00:40:34.670128+0000","last_unstale":"2023-11-19T00:40:45.708044+0000","last_undegraded":"2023-11-19T00:40:45.708044+0000","last_fullsized":"2023-11-19T00:40:45.708044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":109,"reported_epoch":70,"state":"peering","last_fresh":"2023-11-19T00:40:45.708724+0000","last_change":"2023-11-19T00:40:45.708724+0000","last_active":"2023-11-19T00:40:45.708724+0000","last_peered":"2023-11-19T00:40:44.703953+0000","last_clean":"2023-11-19T00:40:44.703953+0000","last_became_active":"2023-11-19T00:40:25.679401+0000","last_became_peered":"2023-11-19T00:40:25.679401+0000","last_unstale":"2023-11-19T00:40:45.708724+0000","last_undegraded":"2023-11-19T00:40:45.708724+0000","last_fullsized":"2023-11-19T00:40:45.708724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":618,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:48.497187+0000","last_change":"2023-11-19T00:40:48.629821+0000","last_active":"2023-11-19T00:40:48.629821+0000","last_peered":"2023-11-19T00:40:48.497187+0000","last_clean":"2023-11-19T00:40:44.700200+0000","last_became_active":"2023-11-19T00:40:47.637659+0000","last_became_peered":"2023-11-19T00:40:47.637659+0000","last_unstale":"2023-11-19T00:40:48.497187+0000","last_undegraded":"2023-11-19T00:40:48.497187+0000","last_fullsized":"2023-11-19T00:40:47.621973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.627033+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:47.627033+0000","last_peered":"2023-11-19T00:40:47.627033+0000","last_clean":"2023-11-19T00:40:47.627033+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:47.627033+0000","last_undegraded":"2023-11-19T00:40:47.627033+0000","last_fullsized":"2023-11-19T00:40:47.627033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"peering","last_fresh":"2023-11-19T00:40:44.702576+0000","last_change":"2023-11-19T00:40:34.667353+0000","last_active":"2023-11-19T00:38:42.752781+0000","last_peered":"2023-11-19T00:38:42.752781+0000","last_clean":"2023-11-19T00:38:42.752781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-19T00:40:44.702576+0000","last_undegraded":"2023-11-19T00:40:44.702576+0000","last_fullsized":"2023-11-19T00:40:44.702576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":235,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.620911+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:47.620911+0000","last_peered":"2023-11-19T00:40:47.620911+0000","last_clean":"2023-11-19T00:40:47.620911+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:47.620911+0000","last_undegraded":"2023-11-19T00:40:47.620911+0000","last_fullsized":"2023-11-19T00:40:47.620911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622437+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:47.622437+0000","last_peered":"2023-11-19T00:40:47.622437+0000","last_clean":"2023-11-19T00:40:47.622437+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:47.622437+0000","last_undegraded":"2023-11-19T00:40:47.622437+0000","last_fullsized":"2023-11-19T00:40:47.622437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":440,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.632255+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:48.632255+0000","last_peered":"2023-11-19T00:40:48.632255+0000","last_clean":"2023-11-19T00:40:48.632255+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:48.632255+0000","last_undegraded":"2023-11-19T00:40:48.632255+0000","last_fullsized":"2023-11-19T00:40:48.632255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":238,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.628311+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:48.628311+0000","last_peered":"2023-11-19T00:40:48.628311+0000","last_clean":"2023-11-19T00:40:48.628311+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:48.628311+0000","last_undegraded":"2023-11-19T00:40:48.628311+0000","last_fullsized":"2023-11-19T00:40:48.628311+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":70,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.625567+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:47.625567+0000","last_peered":"2023-11-19T00:40:47.625567+0000","last_clean":"2023-11-19T00:40:47.625567+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:47.625567+0000","last_undegraded":"2023-11-19T00:40:47.625567+0000","last_fullsized":"2023-11-19T00:40:47.625567+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":219,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627725+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:48.627725+0000","last_peered":"2023-11-19T00:40:48.627725+0000","last_clean":"2023-11-19T00:40:48.627725+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:48.627725+0000","last_undegraded":"2023-11-19T00:40:48.627725+0000","last_fullsized":"2023-11-19T00:40:48.627725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626409+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:48.626409+0000","last_peered":"2023-11-19T00:40:48.626409+0000","last_clean":"2023-11-19T00:40:48.626409+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:48.626409+0000","last_undegraded":"2023-11-19T00:40:48.626409+0000","last_fullsized":"2023-11-19T00:40:48.626409+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":236,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.626017+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:47.626017+0000","last_peered":"2023-11-19T00:40:47.626017+0000","last_clean":"2023-11-19T00:40:47.626017+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:47.626017+0000","last_undegraded":"2023-11-19T00:40:47.626017+0000","last_fullsized":"2023-11-19T00:40:47.626017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.645585+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:47.645585+0000","last_peered":"2023-11-19T00:40:47.645585+0000","last_clean":"2023-11-19T00:40:47.645585+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:47.645585+0000","last_undegraded":"2023-11-19T00:40:47.645585+0000","last_fullsized":"2023-11-19T00:40:47.645585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":678,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:47.789488+0000","last_change":"2023-11-19T00:40:48.628370+0000","last_active":"2023-11-19T00:40:48.628370+0000","last_peered":"2023-11-19T00:40:47.789488+0000","last_clean":"2023-11-19T00:40:41.689349+0000","last_became_active":"2023-11-19T00:40:47.644304+0000","last_became_peered":"2023-11-19T00:40:47.644304+0000","last_unstale":"2023-11-19T00:40:47.789488+0000","last_undegraded":"2023-11-19T00:40:47.789488+0000","last_fullsized":"2023-11-19T00:40:47.623849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.625020+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:47.625020+0000","last_peered":"2023-11-19T00:40:47.625020+0000","last_clean":"2023-11-19T00:40:47.625020+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:47.625020+0000","last_undegraded":"2023-11-19T00:40:47.625020+0000","last_fullsized":"2023-11-19T00:40:47.625020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":201,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680523+0000","last_change":"2023-11-19T00:40:25.684741+0000","last_active":"2023-11-19T00:40:40.680523+0000","last_peered":"2023-11-19T00:40:40.680523+0000","last_clean":"2023-11-19T00:40:40.680523+0000","last_became_active":"2023-11-19T00:40:25.682050+0000","last_became_peered":"2023-11-19T00:40:25.682050+0000","last_unstale":"2023-11-19T00:40:40.680523+0000","last_undegraded":"2023-11-19T00:40:40.680523+0000","last_fullsized":"2023-11-19T00:40:40.680523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2023-11-19T00:40:41.971521+0000","last_change":"2023-11-19T00:40:48.628504+0000","last_active":"2023-11-19T00:40:48.628504+0000","last_peered":"2023-11-19T00:40:41.971521+0000","last_clean":"2023-11-19T00:40:41.971521+0000","last_became_active":"2023-11-19T00:40:31.661608+0000","last_became_peered":"2023-11-19T00:40:31.661608+0000","last_unstale":"2023-11-19T00:40:41.971521+0000","last_undegraded":"2023-11-19T00:40:41.971521+0000","last_fullsized":"2023-11-19T00:40:41.971521+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":222,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-19T00:40:40.680746+0000","last_change":"2023-11-19T00:40:25.684310+0000","last_active":"2023-11-19T00:40:40.680746+0000","last_peered":"2023-11-19T00:40:40.680746+0000","last_clean":"2023-11-19T00:40:40.680746+0000","last_became_active":"2023-11-19T00:40:25.682436+0000","last_became_peered":"2023-11-19T00:40:25.682436+0000","last_unstale":"2023-11-19T00:40:40.680746+0000","last_undegraded":"2023-11-19T00:40:40.680746+0000","last_fullsized":"2023-11-19T00:40:40.680746+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:05:47.111659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":117,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.626935+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:47.626935+0000","last_peered":"2023-11-19T00:40:47.626935+0000","last_clean":"2023-11-19T00:40:47.626935+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:47.626935+0000","last_undegraded":"2023-11-19T00:40:47.626935+0000","last_fullsized":"2023-11-19T00:40:47.626935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":473,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626419+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:48.626419+0000","last_peered":"2023-11-19T00:40:48.626419+0000","last_clean":"2023-11-19T00:40:48.626419+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:48.626419+0000","last_undegraded":"2023-11-19T00:40:48.626419+0000","last_fullsized":"2023-11-19T00:40:48.626419+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":69,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623329+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:47.623329+0000","last_peered":"2023-11-19T00:40:47.623329+0000","last_clean":"2023-11-19T00:40:47.623329+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:47.623329+0000","last_undegraded":"2023-11-19T00:40:47.623329+0000","last_fullsized":"2023-11-19T00:40:47.623329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":240,"reported_epoch":70,"state":"active+recovery_wait+remapped","last_fresh":"2023-11-19T00:40:45.724936+0000","last_change":"2023-11-19T00:40:45.724936+0000","last_active":"2023-11-19T00:40:45.724936+0000","last_peered":"2023-11-19T00:40:45.724936+0000","last_clean":"2023-11-19T00:40:23.621165+0000","last_became_active":"2023-11-19T00:40:45.723613+0000","last_became_peered":"2023-11-19T00:40:45.723613+0000","last_unstale":"2023-11-19T00:40:45.724936+0000","last_undegraded":"2023-11-19T00:40:45.724936+0000","last_fullsized":"2023-11-19T00:40:45.724936+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:11:21.799199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":122,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":64}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.629149+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:48.629149+0000","last_peered":"2023-11-19T00:40:48.629149+0000","last_clean":"2023-11-19T00:40:48.629149+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:48.629149+0000","last_undegraded":"2023-11-19T00:40:48.629149+0000","last_fullsized":"2023-11-19T00:40:48.629149+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":321,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4969,"num_bytes_recovered":27559297,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84156416,"data_stored":61753616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":124,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41048395,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":429,"num_write_kb":40612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86364160,"data_stored":86291788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106896,"kb_used_data":53504,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94264944,"statfs":{"total":96636764160,"available":96527302656,"internally_reserved":0,"allocated":54788096,"data_stored":46798481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738400,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108388,"kb_used_data":59152,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94263452,"statfs":{"total":96636764160,"available":96525774848,"internally_reserved":0,"allocated":60571648,"data_stored":52239240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.29899999999999999}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.34599999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738398,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110396,"kb_used_data":57000,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94261444,"statfs":{"total":96636764160,"available":96523718656,"internally_reserved":0,"allocated":58368000,"data_stored":51083292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.184},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.20499999999999999}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.313},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.28299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24293376,"data_stored":24271019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32659787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29827072,"data_stored":22231433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27721728,"data_stored":20833680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26607616,"data_stored":18688503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:40:52.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:40:53.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:53.259 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:40:53.269 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2023-11-19T00:40:53.046913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67851131,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11024,"num_write_kb":82482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10820,"ondisk_log_size":10820,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":321944,"kb_used_data":161768,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282793576,"statfs":{"total":289910292480,"available":289580621824,"internally_reserved":0,"allocated":165650432,"data_stored":143975737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":109408,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":-306,"num_objects_misplaced":-647,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2055,"num_bytes_recovered":17627946,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.427604"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628335+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:49.628335+0000","last_peered":"2023-11-19T00:40:49.628335+0000","last_clean":"2023-11-19T00:40:49.628335+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:49.628335+0000","last_undegraded":"2023-11-19T00:40:49.628335+0000","last_fullsized":"2023-11-19T00:40:49.628335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":225,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627893+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:49.627893+0000","last_peered":"2023-11-19T00:40:49.627893+0000","last_clean":"2023-11-19T00:40:49.627893+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:49.627893+0000","last_undegraded":"2023-11-19T00:40:49.627893+0000","last_fullsized":"2023-11-19T00:40:49.627893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641372+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:49.641372+0000","last_peered":"2023-11-19T00:40:49.641372+0000","last_clean":"2023-11-19T00:40:49.641372+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:49.641372+0000","last_undegraded":"2023-11-19T00:40:49.641372+0000","last_fullsized":"2023-11-19T00:40:49.641372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:12.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650672+0000","last_change":"2023-11-19T00:40:49.649721+0000","last_active":"2023-11-19T00:40:49.650672+0000","last_peered":"2023-11-19T00:40:49.650672+0000","last_clean":"2023-11-19T00:40:49.650672+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:40:49.650672+0000","last_undegraded":"2023-11-19T00:40:49.650672+0000","last_fullsized":"2023-11-19T00:40:49.650672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:37.114888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":497,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632731+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:50.632731+0000","last_peered":"2023-11-19T00:40:50.632731+0000","last_clean":"2023-11-19T00:40:50.632731+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:50.632731+0000","last_undegraded":"2023-11-19T00:40:50.632731+0000","last_fullsized":"2023-11-19T00:40:50.632731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:47.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":452,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650631+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:40:49.650631+0000","last_peered":"2023-11-19T00:40:49.650631+0000","last_clean":"2023-11-19T00:40:49.650631+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:40:49.650631+0000","last_undegraded":"2023-11-19T00:40:49.650631+0000","last_fullsized":"2023-11-19T00:40:49.650631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:58.153284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646821+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:40:49.646821+0000","last_peered":"2023-11-19T00:40:49.646821+0000","last_clean":"2023-11-19T00:40:49.646821+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:40:49.646821+0000","last_undegraded":"2023-11-19T00:40:49.646821+0000","last_fullsized":"2023-11-19T00:40:49.646821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:27.819649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":367,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646895+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:40:49.646895+0000","last_peered":"2023-11-19T00:40:49.646895+0000","last_clean":"2023-11-19T00:40:49.646895+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:40:49.646895+0000","last_undegraded":"2023-11-19T00:40:49.646895+0000","last_fullsized":"2023-11-19T00:40:49.646895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:28:17.058785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":234,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.621993+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:47.621993+0000","last_peered":"2023-11-19T00:40:47.621993+0000","last_clean":"2023-11-19T00:40:47.621993+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:47.621993+0000","last_undegraded":"2023-11-19T00:40:47.621993+0000","last_fullsized":"2023-11-19T00:40:47.621993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.644989+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:49.644989+0000","last_peered":"2023-11-19T00:40:49.644989+0000","last_clean":"2023-11-19T00:40:49.644989+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:49.644989+0000","last_undegraded":"2023-11-19T00:40:49.644989+0000","last_fullsized":"2023-11-19T00:40:49.644989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:44:32.870644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":454,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.645206+0000","last_change":"2023-11-19T00:40:49.644469+0000","last_active":"2023-11-19T00:40:49.645206+0000","last_peered":"2023-11-19T00:40:49.645206+0000","last_clean":"2023-11-19T00:40:49.645206+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:40:49.645206+0000","last_undegraded":"2023-11-19T00:40:49.645206+0000","last_fullsized":"2023-11-19T00:40:49.645206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":210,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628929+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:49.628929+0000","last_peered":"2023-11-19T00:40:49.628929+0000","last_clean":"2023-11-19T00:40:49.628929+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:49.628929+0000","last_undegraded":"2023-11-19T00:40:49.628929+0000","last_fullsized":"2023-11-19T00:40:49.628929+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":571,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628623+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:49.628623+0000","last_peered":"2023-11-19T00:40:49.628623+0000","last_clean":"2023-11-19T00:40:49.628623+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:49.628623+0000","last_undegraded":"2023-11-19T00:40:49.628623+0000","last_fullsized":"2023-11-19T00:40:49.628623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639473+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:40:49.639473+0000","last_peered":"2023-11-19T00:40:49.639473+0000","last_clean":"2023-11-19T00:40:49.639473+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:40:49.639473+0000","last_undegraded":"2023-11-19T00:40:49.639473+0000","last_fullsized":"2023-11-19T00:40:49.639473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:28.029932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.636177+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:40:49.636177+0000","last_peered":"2023-11-19T00:40:49.636177+0000","last_clean":"2023-11-19T00:40:49.636177+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:40:49.636177+0000","last_undegraded":"2023-11-19T00:40:49.636177+0000","last_fullsized":"2023-11-19T00:40:49.636177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:48:06.968931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":228,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646944+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:40:49.646944+0000","last_peered":"2023-11-19T00:40:49.646944+0000","last_clean":"2023-11-19T00:40:49.646944+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:40:49.646944+0000","last_undegraded":"2023-11-19T00:40:49.646944+0000","last_fullsized":"2023-11-19T00:40:49.646944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:51.342591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":219,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622954+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:47.622954+0000","last_peered":"2023-11-19T00:40:47.622954+0000","last_clean":"2023-11-19T00:40:47.622954+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:47.622954+0000","last_undegraded":"2023-11-19T00:40:47.622954+0000","last_fullsized":"2023-11-19T00:40:47.622954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628168+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:49.628168+0000","last_peered":"2023-11-19T00:40:49.628168+0000","last_clean":"2023-11-19T00:40:49.628168+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:49.628168+0000","last_undegraded":"2023-11-19T00:40:49.628168+0000","last_fullsized":"2023-11-19T00:40:49.628168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":414,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.625991+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:48.625991+0000","last_peered":"2023-11-19T00:40:48.625991+0000","last_clean":"2023-11-19T00:40:48.625991+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:48.625991+0000","last_undegraded":"2023-11-19T00:40:48.625991+0000","last_fullsized":"2023-11-19T00:40:48.625991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":213,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650928+0000","last_change":"2023-11-19T00:40:49.650228+0000","last_active":"2023-11-19T00:40:49.650928+0000","last_peered":"2023-11-19T00:40:49.650928+0000","last_clean":"2023-11-19T00:40:49.650928+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:40:49.650928+0000","last_undegraded":"2023-11-19T00:40:49.650928+0000","last_fullsized":"2023-11-19T00:40:49.650928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649923+0000","last_change":"2023-11-19T00:40:49.648626+0000","last_active":"2023-11-19T00:40:49.649923+0000","last_peered":"2023-11-19T00:40:49.649923+0000","last_clean":"2023-11-19T00:40:49.649923+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:40:49.649923+0000","last_undegraded":"2023-11-19T00:40:49.649923+0000","last_fullsized":"2023-11-19T00:40:49.649923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627938+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:49.627938+0000","last_peered":"2023-11-19T00:40:49.627938+0000","last_clean":"2023-11-19T00:40:49.627938+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:49.627938+0000","last_undegraded":"2023-11-19T00:40:49.627938+0000","last_fullsized":"2023-11-19T00:40:49.627938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":216,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.620799+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:47.620799+0000","last_peered":"2023-11-19T00:40:47.620799+0000","last_clean":"2023-11-19T00:40:47.620799+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:47.620799+0000","last_undegraded":"2023-11-19T00:40:47.620799+0000","last_fullsized":"2023-11-19T00:40:47.620799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627650+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:49.627650+0000","last_peered":"2023-11-19T00:40:49.627650+0000","last_clean":"2023-11-19T00:40:49.627650+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:49.627650+0000","last_undegraded":"2023-11-19T00:40:49.627650+0000","last_fullsized":"2023-11-19T00:40:49.627650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":248,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628440+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:49.628440+0000","last_peered":"2023-11-19T00:40:49.628440+0000","last_clean":"2023-11-19T00:40:49.628440+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:49.628440+0000","last_undegraded":"2023-11-19T00:40:49.628440+0000","last_fullsized":"2023-11-19T00:40:49.628440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":250,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623132+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:47.623132+0000","last_peered":"2023-11-19T00:40:47.623132+0000","last_clean":"2023-11-19T00:40:47.623132+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:47.623132+0000","last_undegraded":"2023-11-19T00:40:47.623132+0000","last_fullsized":"2023-11-19T00:40:47.623132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":219,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641351+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:49.641351+0000","last_peered":"2023-11-19T00:40:49.641351+0000","last_clean":"2023-11-19T00:40:49.641351+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:49.641351+0000","last_undegraded":"2023-11-19T00:40:49.641351+0000","last_fullsized":"2023-11-19T00:40:49.641351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:20.062298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628704+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:49.628704+0000","last_peered":"2023-11-19T00:40:49.628704+0000","last_clean":"2023-11-19T00:40:49.628704+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:49.628704+0000","last_undegraded":"2023-11-19T00:40:49.628704+0000","last_fullsized":"2023-11-19T00:40:49.628704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":658,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:48.909981+0000","last_change":"2023-11-19T00:40:48.910157+0000","last_active":"2023-11-19T00:40:48.909981+0000","last_peered":"2023-11-19T00:40:48.909981+0000","last_clean":"2023-11-19T00:40:27.631223+0000","last_became_active":"2023-11-19T00:40:47.638423+0000","last_became_peered":"2023-11-19T00:40:47.638423+0000","last_unstale":"2023-11-19T00:40:48.909981+0000","last_undegraded":"2023-11-19T00:40:48.909981+0000","last_fullsized":"2023-11-19T00:40:47.622411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:17.209630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":64}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628930+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:50.628930+0000","last_peered":"2023-11-19T00:40:50.628930+0000","last_clean":"2023-11-19T00:40:50.628930+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:50.628930+0000","last_undegraded":"2023-11-19T00:40:50.628930+0000","last_fullsized":"2023-11-19T00:40:50.628930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":760,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:48.144582+0000","last_change":"2023-11-19T00:40:48.629951+0000","last_active":"2023-11-19T00:40:48.629951+0000","last_peered":"2023-11-19T00:40:48.144582+0000","last_clean":"2023-11-19T00:40:44.698753+0000","last_became_active":"2023-11-19T00:40:47.637260+0000","last_became_peered":"2023-11-19T00:40:47.637260+0000","last_unstale":"2023-11-19T00:40:48.144582+0000","last_undegraded":"2023-11-19T00:40:48.144582+0000","last_fullsized":"2023-11-19T00:40:47.620927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":232,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646921+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:49.646921+0000","last_peered":"2023-11-19T00:40:49.646921+0000","last_clean":"2023-11-19T00:40:49.646921+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:49.646921+0000","last_undegraded":"2023-11-19T00:40:49.646921+0000","last_fullsized":"2023-11-19T00:40:49.646921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:41.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":403,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632086+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:50.632086+0000","last_peered":"2023-11-19T00:40:50.632086+0000","last_clean":"2023-11-19T00:40:50.632086+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:50.632086+0000","last_undegraded":"2023-11-19T00:40:50.632086+0000","last_fullsized":"2023-11-19T00:40:50.632086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:05.688454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"69'137","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650028+0000","last_change":"2023-11-19T00:40:49.648913+0000","last_active":"2023-11-19T00:40:49.650028+0000","last_peered":"2023-11-19T00:40:49.650028+0000","last_clean":"2023-11-19T00:40:49.650028+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:40:49.650028+0000","last_undegraded":"2023-11-19T00:40:49.650028+0000","last_fullsized":"2023-11-19T00:40:49.650028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:46.312569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2979871,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":2984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.632567+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:49.632567+0000","last_peered":"2023-11-19T00:40:49.632567+0000","last_clean":"2023-11-19T00:40:49.632567+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:49.632567+0000","last_undegraded":"2023-11-19T00:40:49.632567+0000","last_fullsized":"2023-11-19T00:40:49.632567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:46.760399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.624252+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:47.624252+0000","last_peered":"2023-11-19T00:40:47.624252+0000","last_clean":"2023-11-19T00:40:47.624252+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:47.624252+0000","last_undegraded":"2023-11-19T00:40:47.624252+0000","last_fullsized":"2023-11-19T00:40:47.624252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":238,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623497+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:47.623497+0000","last_peered":"2023-11-19T00:40:47.623497+0000","last_clean":"2023-11-19T00:40:47.623497+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:47.623497+0000","last_undegraded":"2023-11-19T00:40:47.623497+0000","last_fullsized":"2023-11-19T00:40:47.623497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627575+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:49.627575+0000","last_peered":"2023-11-19T00:40:49.627575+0000","last_clean":"2023-11-19T00:40:49.627575+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:49.627575+0000","last_undegraded":"2023-11-19T00:40:49.627575+0000","last_fullsized":"2023-11-19T00:40:49.627575+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":207,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.629142+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:48.629142+0000","last_peered":"2023-11-19T00:40:48.629142+0000","last_clean":"2023-11-19T00:40:48.629142+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:48.629142+0000","last_undegraded":"2023-11-19T00:40:48.629142+0000","last_fullsized":"2023-11-19T00:40:48.629142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":98,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638935+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:40:49.638935+0000","last_peered":"2023-11-19T00:40:49.638935+0000","last_clean":"2023-11-19T00:40:49.638935+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:40:49.638935+0000","last_undegraded":"2023-11-19T00:40:49.638935+0000","last_fullsized":"2023-11-19T00:40:49.638935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638412+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:40:49.638412+0000","last_peered":"2023-11-19T00:40:49.638412+0000","last_clean":"2023-11-19T00:40:49.638412+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:40:49.638412+0000","last_undegraded":"2023-11-19T00:40:49.638412+0000","last_fullsized":"2023-11-19T00:40:49.638412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:07.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":236,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628072+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:49.628072+0000","last_peered":"2023-11-19T00:40:49.628072+0000","last_clean":"2023-11-19T00:40:49.628072+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:49.628072+0000","last_undegraded":"2023-11-19T00:40:49.628072+0000","last_fullsized":"2023-11-19T00:40:49.628072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628327+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:49.628327+0000","last_peered":"2023-11-19T00:40:49.628327+0000","last_clean":"2023-11-19T00:40:49.628327+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:49.628327+0000","last_undegraded":"2023-11-19T00:40:49.628327+0000","last_fullsized":"2023-11-19T00:40:49.628327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627344+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:49.627344+0000","last_peered":"2023-11-19T00:40:49.627344+0000","last_clean":"2023-11-19T00:40:49.627344+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:49.627344+0000","last_undegraded":"2023-11-19T00:40:49.627344+0000","last_fullsized":"2023-11-19T00:40:49.627344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639843+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:40:49.639843+0000","last_peered":"2023-11-19T00:40:49.639843+0000","last_clean":"2023-11-19T00:40:49.639843+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:40:49.639843+0000","last_undegraded":"2023-11-19T00:40:49.639843+0000","last_fullsized":"2023-11-19T00:40:49.639843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:51.721484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":413,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646452+0000","last_change":"2023-11-19T00:40:49.645680+0000","last_active":"2023-11-19T00:40:49.646452+0000","last_peered":"2023-11-19T00:40:49.646452+0000","last_clean":"2023-11-19T00:40:49.646452+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:40:49.646452+0000","last_undegraded":"2023-11-19T00:40:49.646452+0000","last_fullsized":"2023-11-19T00:40:49.646452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:13:29.817706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650913+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:40:49.650913+0000","last_peered":"2023-11-19T00:40:49.650913+0000","last_clean":"2023-11-19T00:40:49.650913+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:40:49.650913+0000","last_undegraded":"2023-11-19T00:40:49.650913+0000","last_fullsized":"2023-11-19T00:40:49.650913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:16.205545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":225,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.621694+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:47.621694+0000","last_peered":"2023-11-19T00:40:47.621694+0000","last_clean":"2023-11-19T00:40:47.621694+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:47.621694+0000","last_undegraded":"2023-11-19T00:40:47.621694+0000","last_fullsized":"2023-11-19T00:40:47.621694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627716+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:48.627716+0000","last_peered":"2023-11-19T00:40:48.627716+0000","last_clean":"2023-11-19T00:40:48.627716+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:48.627716+0000","last_undegraded":"2023-11-19T00:40:48.627716+0000","last_fullsized":"2023-11-19T00:40:48.627716+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650873+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:40:49.650873+0000","last_peered":"2023-11-19T00:40:49.650873+0000","last_clean":"2023-11-19T00:40:49.650873+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:40:49.650873+0000","last_undegraded":"2023-11-19T00:40:49.650873+0000","last_fullsized":"2023-11-19T00:40:49.650873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:19.506460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650850+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:49.650850+0000","last_peered":"2023-11-19T00:40:49.650850+0000","last_clean":"2023-11-19T00:40:49.650850+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:49.650850+0000","last_undegraded":"2023-11-19T00:40:49.650850+0000","last_fullsized":"2023-11-19T00:40:49.650850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:32.771756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641360+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:40:49.641360+0000","last_peered":"2023-11-19T00:40:49.641360+0000","last_clean":"2023-11-19T00:40:49.641360+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:40:49.641360+0000","last_undegraded":"2023-11-19T00:40:49.641360+0000","last_fullsized":"2023-11-19T00:40:49.641360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:22.553304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627675+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:49.627675+0000","last_peered":"2023-11-19T00:40:49.627675+0000","last_clean":"2023-11-19T00:40:49.627675+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:49.627675+0000","last_undegraded":"2023-11-19T00:40:49.627675+0000","last_fullsized":"2023-11-19T00:40:49.627675+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":572,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638343+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:40:49.638343+0000","last_peered":"2023-11-19T00:40:49.638343+0000","last_clean":"2023-11-19T00:40:49.638343+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:40:49.638343+0000","last_undegraded":"2023-11-19T00:40:49.638343+0000","last_fullsized":"2023-11-19T00:40:49.638343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:50.437778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627558+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:49.627558+0000","last_peered":"2023-11-19T00:40:49.627558+0000","last_clean":"2023-11-19T00:40:49.627558+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:49.627558+0000","last_undegraded":"2023-11-19T00:40:49.627558+0000","last_fullsized":"2023-11-19T00:40:49.627558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":205,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622080+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:47.622080+0000","last_peered":"2023-11-19T00:40:47.622080+0000","last_clean":"2023-11-19T00:40:47.622080+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:47.622080+0000","last_undegraded":"2023-11-19T00:40:47.622080+0000","last_fullsized":"2023-11-19T00:40:47.622080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":306,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638672+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:49.638672+0000","last_peered":"2023-11-19T00:40:49.638672+0000","last_clean":"2023-11-19T00:40:49.638672+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:49.638672+0000","last_undegraded":"2023-11-19T00:40:49.638672+0000","last_fullsized":"2023-11-19T00:40:49.638672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:51.392980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650550+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:49.650550+0000","last_peered":"2023-11-19T00:40:49.650550+0000","last_clean":"2023-11-19T00:40:49.650550+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:49.650550+0000","last_undegraded":"2023-11-19T00:40:49.650550+0000","last_fullsized":"2023-11-19T00:40:49.650550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:44.483221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638914+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:49.638914+0000","last_peered":"2023-11-19T00:40:49.638914+0000","last_clean":"2023-11-19T00:40:49.638914+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:49.638914+0000","last_undegraded":"2023-11-19T00:40:49.638914+0000","last_fullsized":"2023-11-19T00:40:49.638914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:57.791481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":427,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828679+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:50.828679+0000","last_peered":"2023-11-19T00:40:50.828679+0000","last_clean":"2023-11-19T00:40:50.828679+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:50.828679+0000","last_undegraded":"2023-11-19T00:40:50.828679+0000","last_fullsized":"2023-11-19T00:40:50.828679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:02.150359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638326+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:49.638326+0000","last_peered":"2023-11-19T00:40:49.638326+0000","last_clean":"2023-11-19T00:40:49.638326+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:49.638326+0000","last_undegraded":"2023-11-19T00:40:49.638326+0000","last_fullsized":"2023-11-19T00:40:49.638326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:03:04.935661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":134,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626547+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:48.626547+0000","last_peered":"2023-11-19T00:40:48.626547+0000","last_clean":"2023-11-19T00:40:48.626547+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:48.626547+0000","last_undegraded":"2023-11-19T00:40:48.626547+0000","last_fullsized":"2023-11-19T00:40:48.626547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":653,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627984+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:49.627984+0000","last_peered":"2023-11-19T00:40:49.627984+0000","last_clean":"2023-11-19T00:40:49.627984+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:49.627984+0000","last_undegraded":"2023-11-19T00:40:49.627984+0000","last_fullsized":"2023-11-19T00:40:49.627984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626686+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:48.626686+0000","last_peered":"2023-11-19T00:40:48.626686+0000","last_clean":"2023-11-19T00:40:48.626686+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:48.626686+0000","last_undegraded":"2023-11-19T00:40:48.626686+0000","last_fullsized":"2023-11-19T00:40:48.626686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628153+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:49.628153+0000","last_peered":"2023-11-19T00:40:49.628153+0000","last_clean":"2023-11-19T00:40:49.628153+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:49.628153+0000","last_undegraded":"2023-11-19T00:40:49.628153+0000","last_fullsized":"2023-11-19T00:40:49.628153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":669,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:48.638425+0000","last_change":"2023-11-19T00:40:48.638583+0000","last_active":"2023-11-19T00:40:48.638425+0000","last_peered":"2023-11-19T00:40:48.638425+0000","last_clean":"2023-11-19T00:40:32.513875+0000","last_became_active":"2023-11-19T00:40:47.637497+0000","last_became_peered":"2023-11-19T00:40:47.637497+0000","last_unstale":"2023-11-19T00:40:48.638425+0000","last_undegraded":"2023-11-19T00:40:48.638425+0000","last_fullsized":"2023-11-19T00:40:47.622233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:49.502796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":61}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650608+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:49.650608+0000","last_peered":"2023-11-19T00:40:49.650608+0000","last_clean":"2023-11-19T00:40:49.650608+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:49.650608+0000","last_undegraded":"2023-11-19T00:40:49.650608+0000","last_fullsized":"2023-11-19T00:40:49.650608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:27.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828155+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:50.828155+0000","last_peered":"2023-11-19T00:40:50.828155+0000","last_clean":"2023-11-19T00:40:50.828155+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:50.828155+0000","last_undegraded":"2023-11-19T00:40:50.828155+0000","last_fullsized":"2023-11-19T00:40:50.828155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:37:55.011970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":453,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.632364+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:48.632364+0000","last_peered":"2023-11-19T00:40:48.632364+0000","last_clean":"2023-11-19T00:40:48.632364+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:48.632364+0000","last_undegraded":"2023-11-19T00:40:48.632364+0000","last_fullsized":"2023-11-19T00:40:48.632364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828779+0000","last_change":"2023-11-19T00:40:49.644207+0000","last_active":"2023-11-19T00:40:50.828779+0000","last_peered":"2023-11-19T00:40:50.828779+0000","last_clean":"2023-11-19T00:40:50.828779+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:40:50.828779+0000","last_undegraded":"2023-11-19T00:40:50.828779+0000","last_fullsized":"2023-11-19T00:40:50.828779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:09.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.630059+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:48.630059+0000","last_peered":"2023-11-19T00:40:48.630059+0000","last_clean":"2023-11-19T00:40:48.630059+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:48.630059+0000","last_undegraded":"2023-11-19T00:40:48.630059+0000","last_fullsized":"2023-11-19T00:40:48.630059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":241,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639279+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:49.639279+0000","last_peered":"2023-11-19T00:40:49.639279+0000","last_clean":"2023-11-19T00:40:49.639279+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:49.639279+0000","last_undegraded":"2023-11-19T00:40:49.639279+0000","last_fullsized":"2023-11-19T00:40:49.639279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:39.542692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626047+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:48.626047+0000","last_peered":"2023-11-19T00:40:48.626047+0000","last_clean":"2023-11-19T00:40:48.626047+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:48.626047+0000","last_undegraded":"2023-11-19T00:40:48.626047+0000","last_fullsized":"2023-11-19T00:40:48.626047+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628872+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:49.628872+0000","last_peered":"2023-11-19T00:40:49.628872+0000","last_clean":"2023-11-19T00:40:49.628872+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:49.628872+0000","last_undegraded":"2023-11-19T00:40:49.628872+0000","last_fullsized":"2023-11-19T00:40:49.628872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623294+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:47.623294+0000","last_peered":"2023-11-19T00:40:47.623294+0000","last_clean":"2023-11-19T00:40:47.623294+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:47.623294+0000","last_undegraded":"2023-11-19T00:40:47.623294+0000","last_fullsized":"2023-11-19T00:40:47.623294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626266+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:48.626266+0000","last_peered":"2023-11-19T00:40:48.626266+0000","last_clean":"2023-11-19T00:40:48.626266+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:48.626266+0000","last_undegraded":"2023-11-19T00:40:48.626266+0000","last_fullsized":"2023-11-19T00:40:48.626266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":221,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.637978+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:48.637978+0000","last_peered":"2023-11-19T00:40:48.637978+0000","last_clean":"2023-11-19T00:40:48.637978+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:48.637978+0000","last_undegraded":"2023-11-19T00:40:48.637978+0000","last_fullsized":"2023-11-19T00:40:48.637978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.628812+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:48.628812+0000","last_peered":"2023-11-19T00:40:48.628812+0000","last_clean":"2023-11-19T00:40:48.628812+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:48.628812+0000","last_undegraded":"2023-11-19T00:40:48.628812+0000","last_fullsized":"2023-11-19T00:40:48.628812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637789+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:49.637789+0000","last_peered":"2023-11-19T00:40:49.637789+0000","last_clean":"2023-11-19T00:40:49.637789+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:49.637789+0000","last_undegraded":"2023-11-19T00:40:49.637789+0000","last_fullsized":"2023-11-19T00:40:49.637789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:54.815254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":222,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627863+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:49.627863+0000","last_peered":"2023-11-19T00:40:49.627863+0000","last_clean":"2023-11-19T00:40:49.627863+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:49.627863+0000","last_undegraded":"2023-11-19T00:40:49.627863+0000","last_fullsized":"2023-11-19T00:40:49.627863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":457,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638278+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:40:49.638278+0000","last_peered":"2023-11-19T00:40:49.638278+0000","last_clean":"2023-11-19T00:40:49.638278+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:40:49.638278+0000","last_undegraded":"2023-11-19T00:40:49.638278+0000","last_fullsized":"2023-11-19T00:40:49.638278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:51.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637727+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:40:49.637727+0000","last_peered":"2023-11-19T00:40:49.637727+0000","last_clean":"2023-11-19T00:40:49.637727+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:40:49.637727+0000","last_undegraded":"2023-11-19T00:40:49.637727+0000","last_fullsized":"2023-11-19T00:40:49.637727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":618,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:48.497187+0000","last_change":"2023-11-19T00:40:48.629821+0000","last_active":"2023-11-19T00:40:48.629821+0000","last_peered":"2023-11-19T00:40:48.497187+0000","last_clean":"2023-11-19T00:40:44.700200+0000","last_became_active":"2023-11-19T00:40:47.637659+0000","last_became_peered":"2023-11-19T00:40:47.637659+0000","last_unstale":"2023-11-19T00:40:48.497187+0000","last_undegraded":"2023-11-19T00:40:48.497187+0000","last_fullsized":"2023-11-19T00:40:47.621973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:49.628637+0000","last_peered":"2023-11-19T00:40:49.628637+0000","last_clean":"2023-11-19T00:40:49.628637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:49.628637+0000","last_undegraded":"2023-11-19T00:40:49.628637+0000","last_fullsized":"2023-11-19T00:40:49.628637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.648800+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:40:49.648800+0000","last_peered":"2023-11-19T00:40:49.648800+0000","last_clean":"2023-11-19T00:40:49.648800+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:40:49.648800+0000","last_undegraded":"2023-11-19T00:40:49.648800+0000","last_fullsized":"2023-11-19T00:40:49.648800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:26:07.616172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":235,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.620911+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:47.620911+0000","last_peered":"2023-11-19T00:40:47.620911+0000","last_clean":"2023-11-19T00:40:47.620911+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:47.620911+0000","last_undegraded":"2023-11-19T00:40:47.620911+0000","last_fullsized":"2023-11-19T00:40:47.620911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622437+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:47.622437+0000","last_peered":"2023-11-19T00:40:47.622437+0000","last_clean":"2023-11-19T00:40:47.622437+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:47.622437+0000","last_undegraded":"2023-11-19T00:40:47.622437+0000","last_fullsized":"2023-11-19T00:40:47.622437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":440,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.632255+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:48.632255+0000","last_peered":"2023-11-19T00:40:48.632255+0000","last_clean":"2023-11-19T00:40:48.632255+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:48.632255+0000","last_undegraded":"2023-11-19T00:40:48.632255+0000","last_fullsized":"2023-11-19T00:40:48.632255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628701+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:49.628701+0000","last_peered":"2023-11-19T00:40:49.628701+0000","last_clean":"2023-11-19T00:40:49.628701+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:49.628701+0000","last_undegraded":"2023-11-19T00:40:49.628701+0000","last_fullsized":"2023-11-19T00:40:49.628701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":70,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.625567+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:47.625567+0000","last_peered":"2023-11-19T00:40:47.625567+0000","last_clean":"2023-11-19T00:40:47.625567+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:47.625567+0000","last_undegraded":"2023-11-19T00:40:47.625567+0000","last_fullsized":"2023-11-19T00:40:47.625567+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":219,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627725+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:48.627725+0000","last_peered":"2023-11-19T00:40:48.627725+0000","last_clean":"2023-11-19T00:40:48.627725+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:48.627725+0000","last_undegraded":"2023-11-19T00:40:48.627725+0000","last_fullsized":"2023-11-19T00:40:48.627725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626409+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:48.626409+0000","last_peered":"2023-11-19T00:40:48.626409+0000","last_clean":"2023-11-19T00:40:48.626409+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:48.626409+0000","last_undegraded":"2023-11-19T00:40:48.626409+0000","last_fullsized":"2023-11-19T00:40:48.626409+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":238,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627896+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:49.627896+0000","last_peered":"2023-11-19T00:40:49.627896+0000","last_clean":"2023-11-19T00:40:49.627896+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:49.627896+0000","last_undegraded":"2023-11-19T00:40:49.627896+0000","last_fullsized":"2023-11-19T00:40:49.627896+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628582+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:49.628582+0000","last_peered":"2023-11-19T00:40:49.628582+0000","last_clean":"2023-11-19T00:40:49.628582+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:49.628582+0000","last_undegraded":"2023-11-19T00:40:49.628582+0000","last_fullsized":"2023-11-19T00:40:49.628582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":687,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647554+0000","last_change":"2023-11-19T00:40:49.647066+0000","last_active":"2023-11-19T00:40:49.647554+0000","last_peered":"2023-11-19T00:40:49.647554+0000","last_clean":"2023-11-19T00:40:49.647554+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:40:49.647554+0000","last_undegraded":"2023-11-19T00:40:49.647554+0000","last_fullsized":"2023-11-19T00:40:49.647554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:51:07.279809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628388+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:49.628388+0000","last_peered":"2023-11-19T00:40:49.628388+0000","last_clean":"2023-11-19T00:40:49.628388+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:49.628388+0000","last_undegraded":"2023-11-19T00:40:49.628388+0000","last_fullsized":"2023-11-19T00:40:49.628388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":189,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649532+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:40:49.649532+0000","last_peered":"2023-11-19T00:40:49.649532+0000","last_clean":"2023-11-19T00:40:49.649532+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:40:49.649532+0000","last_undegraded":"2023-11-19T00:40:49.649532+0000","last_fullsized":"2023-11-19T00:40:49.649532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:25.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650896+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:40:49.650896+0000","last_peered":"2023-11-19T00:40:49.650896+0000","last_clean":"2023-11-19T00:40:49.650896+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:40:49.650896+0000","last_undegraded":"2023-11-19T00:40:49.650896+0000","last_fullsized":"2023-11-19T00:40:49.650896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:30.721704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":212,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650648+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:40:49.650648+0000","last_peered":"2023-11-19T00:40:49.650648+0000","last_clean":"2023-11-19T00:40:49.650648+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:40:49.650648+0000","last_undegraded":"2023-11-19T00:40:49.650648+0000","last_fullsized":"2023-11-19T00:40:49.650648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628523+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:49.628523+0000","last_peered":"2023-11-19T00:40:49.628523+0000","last_clean":"2023-11-19T00:40:49.628523+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:49.628523+0000","last_undegraded":"2023-11-19T00:40:49.628523+0000","last_fullsized":"2023-11-19T00:40:49.628523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627815+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:49.627815+0000","last_peered":"2023-11-19T00:40:49.627815+0000","last_clean":"2023-11-19T00:40:49.627815+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:49.627815+0000","last_undegraded":"2023-11-19T00:40:49.627815+0000","last_fullsized":"2023-11-19T00:40:49.627815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":69,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623329+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:47.623329+0000","last_peered":"2023-11-19T00:40:47.623329+0000","last_clean":"2023-11-19T00:40:47.623329+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:47.623329+0000","last_undegraded":"2023-11-19T00:40:47.623329+0000","last_fullsized":"2023-11-19T00:40:47.623329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":503,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646542+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:40:49.646542+0000","last_peered":"2023-11-19T00:40:49.646542+0000","last_clean":"2023-11-19T00:40:49.646542+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:40:49.646542+0000","last_undegraded":"2023-11-19T00:40:49.646542+0000","last_fullsized":"2023-11-19T00:40:49.646542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:11.509410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.629149+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:48.629149+0000","last_peered":"2023-11-19T00:40:48.629149+0000","last_clean":"2023-11-19T00:40:48.629149+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:48.629149+0000","last_undegraded":"2023-11-19T00:40:48.629149+0000","last_fullsized":"2023-11-19T00:40:48.629149+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76038144,"data_stored":55588760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41048395,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":429,"num_write_kb":40612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86364160,"data_stored":86291788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106896,"kb_used_data":53504,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94264944,"statfs":{"total":96636764160,"available":96527302656,"internally_reserved":0,"allocated":54788096,"data_stored":46798481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738401,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101756,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270084,"statfs":{"total":96636764160,"available":96532566016,"internally_reserved":0,"allocated":53784576,"data_stored":46883073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.55300000000000005}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.65500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738399,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113292,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.184},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.20499999999999999}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.313},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.28299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24293376,"data_stored":24271019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32659787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29827072,"data_stored":22231433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:40:53.273 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-19T00:40:53.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:53.672 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 3 pgs inactive, 3 pgs peering","count":6},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":151,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":75,"num_osds":3,"num_up_osds":3,"osd_up_since":1700354312,"num_in_osds":3,"osd_in_since":1700354303,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":66},{"state_name":"peering","count":29},{"state_name":"active+undersized+remapped","count":4},{"state_name":"active+remapped","count":3},{"state_name":"active+recovery_wait+remapped","count":3}],"num_pgs":105,"num_pools":4,"num_objects":3480,"data_bytes":67851131,"bytes_used":333496320,"bytes_avail":289576796160,"bytes_total":289910292480,"inactive_pgs_ratio":0.27619048953056335,"misplaced_objects":321,"misplaced_total":6960,"misplaced_ratio":0.046120689655172423,"recovering_objects_per_sec":409,"recovering_bytes_per_sec":4180674,"recovering_keys_per_sec":0,"num_objects_recovered":1640,"num_bytes_recovered":16725987,"num_keys_recovered":0,"write_bytes_sec":66546,"read_op_per_sec":0,"write_op_per_sec":35},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4217}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-19T00:39:51.035419+0000","services":{}},"progress_events":{}} 2023-11-19T00:40:53.684 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2023-11-19T00:40:53.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:40:53.987 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:40:53.997 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2023-11-19T00:40:53.046913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67851131,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11024,"num_write_kb":82482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10820,"ondisk_log_size":10820,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":321944,"kb_used_data":161768,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282793576,"statfs":{"total":289910292480,"available":289580621824,"internally_reserved":0,"allocated":165650432,"data_stored":143975737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":109408,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":-306,"num_objects_misplaced":-647,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2055,"num_bytes_recovered":17627946,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.427604"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628335+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:49.628335+0000","last_peered":"2023-11-19T00:40:49.628335+0000","last_clean":"2023-11-19T00:40:49.628335+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:49.628335+0000","last_undegraded":"2023-11-19T00:40:49.628335+0000","last_fullsized":"2023-11-19T00:40:49.628335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":225,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627893+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:49.627893+0000","last_peered":"2023-11-19T00:40:49.627893+0000","last_clean":"2023-11-19T00:40:49.627893+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:49.627893+0000","last_undegraded":"2023-11-19T00:40:49.627893+0000","last_fullsized":"2023-11-19T00:40:49.627893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641372+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:49.641372+0000","last_peered":"2023-11-19T00:40:49.641372+0000","last_clean":"2023-11-19T00:40:49.641372+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:49.641372+0000","last_undegraded":"2023-11-19T00:40:49.641372+0000","last_fullsized":"2023-11-19T00:40:49.641372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:12.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650672+0000","last_change":"2023-11-19T00:40:49.649721+0000","last_active":"2023-11-19T00:40:49.650672+0000","last_peered":"2023-11-19T00:40:49.650672+0000","last_clean":"2023-11-19T00:40:49.650672+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:40:49.650672+0000","last_undegraded":"2023-11-19T00:40:49.650672+0000","last_fullsized":"2023-11-19T00:40:49.650672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:37.114888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":497,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632731+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:50.632731+0000","last_peered":"2023-11-19T00:40:50.632731+0000","last_clean":"2023-11-19T00:40:50.632731+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:50.632731+0000","last_undegraded":"2023-11-19T00:40:50.632731+0000","last_fullsized":"2023-11-19T00:40:50.632731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:47.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":452,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650631+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:40:49.650631+0000","last_peered":"2023-11-19T00:40:49.650631+0000","last_clean":"2023-11-19T00:40:49.650631+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:40:49.650631+0000","last_undegraded":"2023-11-19T00:40:49.650631+0000","last_fullsized":"2023-11-19T00:40:49.650631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:58.153284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646821+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:40:49.646821+0000","last_peered":"2023-11-19T00:40:49.646821+0000","last_clean":"2023-11-19T00:40:49.646821+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:40:49.646821+0000","last_undegraded":"2023-11-19T00:40:49.646821+0000","last_fullsized":"2023-11-19T00:40:49.646821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:27.819649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":367,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646895+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:40:49.646895+0000","last_peered":"2023-11-19T00:40:49.646895+0000","last_clean":"2023-11-19T00:40:49.646895+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:40:49.646895+0000","last_undegraded":"2023-11-19T00:40:49.646895+0000","last_fullsized":"2023-11-19T00:40:49.646895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:28:17.058785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":234,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.621993+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:47.621993+0000","last_peered":"2023-11-19T00:40:47.621993+0000","last_clean":"2023-11-19T00:40:47.621993+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:47.621993+0000","last_undegraded":"2023-11-19T00:40:47.621993+0000","last_fullsized":"2023-11-19T00:40:47.621993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.644989+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:49.644989+0000","last_peered":"2023-11-19T00:40:49.644989+0000","last_clean":"2023-11-19T00:40:49.644989+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:49.644989+0000","last_undegraded":"2023-11-19T00:40:49.644989+0000","last_fullsized":"2023-11-19T00:40:49.644989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:44:32.870644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":454,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.645206+0000","last_change":"2023-11-19T00:40:49.644469+0000","last_active":"2023-11-19T00:40:49.645206+0000","last_peered":"2023-11-19T00:40:49.645206+0000","last_clean":"2023-11-19T00:40:49.645206+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:40:49.645206+0000","last_undegraded":"2023-11-19T00:40:49.645206+0000","last_fullsized":"2023-11-19T00:40:49.645206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":210,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628929+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:49.628929+0000","last_peered":"2023-11-19T00:40:49.628929+0000","last_clean":"2023-11-19T00:40:49.628929+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:49.628929+0000","last_undegraded":"2023-11-19T00:40:49.628929+0000","last_fullsized":"2023-11-19T00:40:49.628929+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":571,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628623+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:49.628623+0000","last_peered":"2023-11-19T00:40:49.628623+0000","last_clean":"2023-11-19T00:40:49.628623+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:49.628623+0000","last_undegraded":"2023-11-19T00:40:49.628623+0000","last_fullsized":"2023-11-19T00:40:49.628623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639473+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:40:49.639473+0000","last_peered":"2023-11-19T00:40:49.639473+0000","last_clean":"2023-11-19T00:40:49.639473+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:40:49.639473+0000","last_undegraded":"2023-11-19T00:40:49.639473+0000","last_fullsized":"2023-11-19T00:40:49.639473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:28.029932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.636177+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:40:49.636177+0000","last_peered":"2023-11-19T00:40:49.636177+0000","last_clean":"2023-11-19T00:40:49.636177+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:40:49.636177+0000","last_undegraded":"2023-11-19T00:40:49.636177+0000","last_fullsized":"2023-11-19T00:40:49.636177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:48:06.968931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":228,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646944+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:40:49.646944+0000","last_peered":"2023-11-19T00:40:49.646944+0000","last_clean":"2023-11-19T00:40:49.646944+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:40:49.646944+0000","last_undegraded":"2023-11-19T00:40:49.646944+0000","last_fullsized":"2023-11-19T00:40:49.646944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:51.342591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":219,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622954+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:47.622954+0000","last_peered":"2023-11-19T00:40:47.622954+0000","last_clean":"2023-11-19T00:40:47.622954+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:47.622954+0000","last_undegraded":"2023-11-19T00:40:47.622954+0000","last_fullsized":"2023-11-19T00:40:47.622954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628168+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:49.628168+0000","last_peered":"2023-11-19T00:40:49.628168+0000","last_clean":"2023-11-19T00:40:49.628168+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:49.628168+0000","last_undegraded":"2023-11-19T00:40:49.628168+0000","last_fullsized":"2023-11-19T00:40:49.628168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":414,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.625991+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:48.625991+0000","last_peered":"2023-11-19T00:40:48.625991+0000","last_clean":"2023-11-19T00:40:48.625991+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:48.625991+0000","last_undegraded":"2023-11-19T00:40:48.625991+0000","last_fullsized":"2023-11-19T00:40:48.625991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":213,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650928+0000","last_change":"2023-11-19T00:40:49.650228+0000","last_active":"2023-11-19T00:40:49.650928+0000","last_peered":"2023-11-19T00:40:49.650928+0000","last_clean":"2023-11-19T00:40:49.650928+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:40:49.650928+0000","last_undegraded":"2023-11-19T00:40:49.650928+0000","last_fullsized":"2023-11-19T00:40:49.650928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649923+0000","last_change":"2023-11-19T00:40:49.648626+0000","last_active":"2023-11-19T00:40:49.649923+0000","last_peered":"2023-11-19T00:40:49.649923+0000","last_clean":"2023-11-19T00:40:49.649923+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:40:49.649923+0000","last_undegraded":"2023-11-19T00:40:49.649923+0000","last_fullsized":"2023-11-19T00:40:49.649923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627938+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:49.627938+0000","last_peered":"2023-11-19T00:40:49.627938+0000","last_clean":"2023-11-19T00:40:49.627938+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:49.627938+0000","last_undegraded":"2023-11-19T00:40:49.627938+0000","last_fullsized":"2023-11-19T00:40:49.627938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":216,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.620799+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:47.620799+0000","last_peered":"2023-11-19T00:40:47.620799+0000","last_clean":"2023-11-19T00:40:47.620799+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:47.620799+0000","last_undegraded":"2023-11-19T00:40:47.620799+0000","last_fullsized":"2023-11-19T00:40:47.620799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627650+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:49.627650+0000","last_peered":"2023-11-19T00:40:49.627650+0000","last_clean":"2023-11-19T00:40:49.627650+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:49.627650+0000","last_undegraded":"2023-11-19T00:40:49.627650+0000","last_fullsized":"2023-11-19T00:40:49.627650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":248,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628440+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:49.628440+0000","last_peered":"2023-11-19T00:40:49.628440+0000","last_clean":"2023-11-19T00:40:49.628440+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:49.628440+0000","last_undegraded":"2023-11-19T00:40:49.628440+0000","last_fullsized":"2023-11-19T00:40:49.628440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":250,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623132+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:47.623132+0000","last_peered":"2023-11-19T00:40:47.623132+0000","last_clean":"2023-11-19T00:40:47.623132+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:47.623132+0000","last_undegraded":"2023-11-19T00:40:47.623132+0000","last_fullsized":"2023-11-19T00:40:47.623132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":219,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641351+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:49.641351+0000","last_peered":"2023-11-19T00:40:49.641351+0000","last_clean":"2023-11-19T00:40:49.641351+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:49.641351+0000","last_undegraded":"2023-11-19T00:40:49.641351+0000","last_fullsized":"2023-11-19T00:40:49.641351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:20.062298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628704+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:49.628704+0000","last_peered":"2023-11-19T00:40:49.628704+0000","last_clean":"2023-11-19T00:40:49.628704+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:49.628704+0000","last_undegraded":"2023-11-19T00:40:49.628704+0000","last_fullsized":"2023-11-19T00:40:49.628704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":658,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:48.909981+0000","last_change":"2023-11-19T00:40:48.910157+0000","last_active":"2023-11-19T00:40:48.909981+0000","last_peered":"2023-11-19T00:40:48.909981+0000","last_clean":"2023-11-19T00:40:27.631223+0000","last_became_active":"2023-11-19T00:40:47.638423+0000","last_became_peered":"2023-11-19T00:40:47.638423+0000","last_unstale":"2023-11-19T00:40:48.909981+0000","last_undegraded":"2023-11-19T00:40:48.909981+0000","last_fullsized":"2023-11-19T00:40:47.622411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:17.209630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":64}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628930+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:50.628930+0000","last_peered":"2023-11-19T00:40:50.628930+0000","last_clean":"2023-11-19T00:40:50.628930+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:50.628930+0000","last_undegraded":"2023-11-19T00:40:50.628930+0000","last_fullsized":"2023-11-19T00:40:50.628930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":760,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:48.144582+0000","last_change":"2023-11-19T00:40:48.629951+0000","last_active":"2023-11-19T00:40:48.629951+0000","last_peered":"2023-11-19T00:40:48.144582+0000","last_clean":"2023-11-19T00:40:44.698753+0000","last_became_active":"2023-11-19T00:40:47.637260+0000","last_became_peered":"2023-11-19T00:40:47.637260+0000","last_unstale":"2023-11-19T00:40:48.144582+0000","last_undegraded":"2023-11-19T00:40:48.144582+0000","last_fullsized":"2023-11-19T00:40:47.620927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":232,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646921+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:49.646921+0000","last_peered":"2023-11-19T00:40:49.646921+0000","last_clean":"2023-11-19T00:40:49.646921+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:49.646921+0000","last_undegraded":"2023-11-19T00:40:49.646921+0000","last_fullsized":"2023-11-19T00:40:49.646921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:41.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":403,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632086+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:50.632086+0000","last_peered":"2023-11-19T00:40:50.632086+0000","last_clean":"2023-11-19T00:40:50.632086+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:50.632086+0000","last_undegraded":"2023-11-19T00:40:50.632086+0000","last_fullsized":"2023-11-19T00:40:50.632086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:05.688454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"69'137","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650028+0000","last_change":"2023-11-19T00:40:49.648913+0000","last_active":"2023-11-19T00:40:49.650028+0000","last_peered":"2023-11-19T00:40:49.650028+0000","last_clean":"2023-11-19T00:40:49.650028+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:40:49.650028+0000","last_undegraded":"2023-11-19T00:40:49.650028+0000","last_fullsized":"2023-11-19T00:40:49.650028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:46.312569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2979871,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":2984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.632567+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:49.632567+0000","last_peered":"2023-11-19T00:40:49.632567+0000","last_clean":"2023-11-19T00:40:49.632567+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:49.632567+0000","last_undegraded":"2023-11-19T00:40:49.632567+0000","last_fullsized":"2023-11-19T00:40:49.632567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:46.760399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.624252+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:47.624252+0000","last_peered":"2023-11-19T00:40:47.624252+0000","last_clean":"2023-11-19T00:40:47.624252+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:47.624252+0000","last_undegraded":"2023-11-19T00:40:47.624252+0000","last_fullsized":"2023-11-19T00:40:47.624252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":238,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623497+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:47.623497+0000","last_peered":"2023-11-19T00:40:47.623497+0000","last_clean":"2023-11-19T00:40:47.623497+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:47.623497+0000","last_undegraded":"2023-11-19T00:40:47.623497+0000","last_fullsized":"2023-11-19T00:40:47.623497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627575+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:49.627575+0000","last_peered":"2023-11-19T00:40:49.627575+0000","last_clean":"2023-11-19T00:40:49.627575+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:49.627575+0000","last_undegraded":"2023-11-19T00:40:49.627575+0000","last_fullsized":"2023-11-19T00:40:49.627575+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":207,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.629142+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:48.629142+0000","last_peered":"2023-11-19T00:40:48.629142+0000","last_clean":"2023-11-19T00:40:48.629142+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:48.629142+0000","last_undegraded":"2023-11-19T00:40:48.629142+0000","last_fullsized":"2023-11-19T00:40:48.629142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":98,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638935+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:40:49.638935+0000","last_peered":"2023-11-19T00:40:49.638935+0000","last_clean":"2023-11-19T00:40:49.638935+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:40:49.638935+0000","last_undegraded":"2023-11-19T00:40:49.638935+0000","last_fullsized":"2023-11-19T00:40:49.638935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638412+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:40:49.638412+0000","last_peered":"2023-11-19T00:40:49.638412+0000","last_clean":"2023-11-19T00:40:49.638412+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:40:49.638412+0000","last_undegraded":"2023-11-19T00:40:49.638412+0000","last_fullsized":"2023-11-19T00:40:49.638412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:07.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":236,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628072+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:49.628072+0000","last_peered":"2023-11-19T00:40:49.628072+0000","last_clean":"2023-11-19T00:40:49.628072+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:49.628072+0000","last_undegraded":"2023-11-19T00:40:49.628072+0000","last_fullsized":"2023-11-19T00:40:49.628072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628327+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:49.628327+0000","last_peered":"2023-11-19T00:40:49.628327+0000","last_clean":"2023-11-19T00:40:49.628327+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:49.628327+0000","last_undegraded":"2023-11-19T00:40:49.628327+0000","last_fullsized":"2023-11-19T00:40:49.628327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627344+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:49.627344+0000","last_peered":"2023-11-19T00:40:49.627344+0000","last_clean":"2023-11-19T00:40:49.627344+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:49.627344+0000","last_undegraded":"2023-11-19T00:40:49.627344+0000","last_fullsized":"2023-11-19T00:40:49.627344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639843+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:40:49.639843+0000","last_peered":"2023-11-19T00:40:49.639843+0000","last_clean":"2023-11-19T00:40:49.639843+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:40:49.639843+0000","last_undegraded":"2023-11-19T00:40:49.639843+0000","last_fullsized":"2023-11-19T00:40:49.639843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:51.721484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":413,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646452+0000","last_change":"2023-11-19T00:40:49.645680+0000","last_active":"2023-11-19T00:40:49.646452+0000","last_peered":"2023-11-19T00:40:49.646452+0000","last_clean":"2023-11-19T00:40:49.646452+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:40:49.646452+0000","last_undegraded":"2023-11-19T00:40:49.646452+0000","last_fullsized":"2023-11-19T00:40:49.646452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:13:29.817706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650913+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:40:49.650913+0000","last_peered":"2023-11-19T00:40:49.650913+0000","last_clean":"2023-11-19T00:40:49.650913+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:40:49.650913+0000","last_undegraded":"2023-11-19T00:40:49.650913+0000","last_fullsized":"2023-11-19T00:40:49.650913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:16.205545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":225,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.621694+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:47.621694+0000","last_peered":"2023-11-19T00:40:47.621694+0000","last_clean":"2023-11-19T00:40:47.621694+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:47.621694+0000","last_undegraded":"2023-11-19T00:40:47.621694+0000","last_fullsized":"2023-11-19T00:40:47.621694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627716+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:48.627716+0000","last_peered":"2023-11-19T00:40:48.627716+0000","last_clean":"2023-11-19T00:40:48.627716+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:48.627716+0000","last_undegraded":"2023-11-19T00:40:48.627716+0000","last_fullsized":"2023-11-19T00:40:48.627716+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650873+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:40:49.650873+0000","last_peered":"2023-11-19T00:40:49.650873+0000","last_clean":"2023-11-19T00:40:49.650873+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:40:49.650873+0000","last_undegraded":"2023-11-19T00:40:49.650873+0000","last_fullsized":"2023-11-19T00:40:49.650873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:19.506460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650850+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:49.650850+0000","last_peered":"2023-11-19T00:40:49.650850+0000","last_clean":"2023-11-19T00:40:49.650850+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:49.650850+0000","last_undegraded":"2023-11-19T00:40:49.650850+0000","last_fullsized":"2023-11-19T00:40:49.650850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:32.771756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641360+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:40:49.641360+0000","last_peered":"2023-11-19T00:40:49.641360+0000","last_clean":"2023-11-19T00:40:49.641360+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:40:49.641360+0000","last_undegraded":"2023-11-19T00:40:49.641360+0000","last_fullsized":"2023-11-19T00:40:49.641360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:22.553304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627675+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:49.627675+0000","last_peered":"2023-11-19T00:40:49.627675+0000","last_clean":"2023-11-19T00:40:49.627675+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:49.627675+0000","last_undegraded":"2023-11-19T00:40:49.627675+0000","last_fullsized":"2023-11-19T00:40:49.627675+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":572,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638343+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:40:49.638343+0000","last_peered":"2023-11-19T00:40:49.638343+0000","last_clean":"2023-11-19T00:40:49.638343+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:40:49.638343+0000","last_undegraded":"2023-11-19T00:40:49.638343+0000","last_fullsized":"2023-11-19T00:40:49.638343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:50.437778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627558+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:49.627558+0000","last_peered":"2023-11-19T00:40:49.627558+0000","last_clean":"2023-11-19T00:40:49.627558+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:49.627558+0000","last_undegraded":"2023-11-19T00:40:49.627558+0000","last_fullsized":"2023-11-19T00:40:49.627558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":205,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622080+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:47.622080+0000","last_peered":"2023-11-19T00:40:47.622080+0000","last_clean":"2023-11-19T00:40:47.622080+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:47.622080+0000","last_undegraded":"2023-11-19T00:40:47.622080+0000","last_fullsized":"2023-11-19T00:40:47.622080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":306,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638672+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:49.638672+0000","last_peered":"2023-11-19T00:40:49.638672+0000","last_clean":"2023-11-19T00:40:49.638672+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:49.638672+0000","last_undegraded":"2023-11-19T00:40:49.638672+0000","last_fullsized":"2023-11-19T00:40:49.638672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:51.392980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650550+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:49.650550+0000","last_peered":"2023-11-19T00:40:49.650550+0000","last_clean":"2023-11-19T00:40:49.650550+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:49.650550+0000","last_undegraded":"2023-11-19T00:40:49.650550+0000","last_fullsized":"2023-11-19T00:40:49.650550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:44.483221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638914+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:49.638914+0000","last_peered":"2023-11-19T00:40:49.638914+0000","last_clean":"2023-11-19T00:40:49.638914+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:49.638914+0000","last_undegraded":"2023-11-19T00:40:49.638914+0000","last_fullsized":"2023-11-19T00:40:49.638914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:57.791481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":427,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828679+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:50.828679+0000","last_peered":"2023-11-19T00:40:50.828679+0000","last_clean":"2023-11-19T00:40:50.828679+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:50.828679+0000","last_undegraded":"2023-11-19T00:40:50.828679+0000","last_fullsized":"2023-11-19T00:40:50.828679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:02.150359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638326+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:49.638326+0000","last_peered":"2023-11-19T00:40:49.638326+0000","last_clean":"2023-11-19T00:40:49.638326+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:49.638326+0000","last_undegraded":"2023-11-19T00:40:49.638326+0000","last_fullsized":"2023-11-19T00:40:49.638326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:03:04.935661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":134,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626547+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:48.626547+0000","last_peered":"2023-11-19T00:40:48.626547+0000","last_clean":"2023-11-19T00:40:48.626547+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:48.626547+0000","last_undegraded":"2023-11-19T00:40:48.626547+0000","last_fullsized":"2023-11-19T00:40:48.626547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":653,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627984+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:49.627984+0000","last_peered":"2023-11-19T00:40:49.627984+0000","last_clean":"2023-11-19T00:40:49.627984+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:49.627984+0000","last_undegraded":"2023-11-19T00:40:49.627984+0000","last_fullsized":"2023-11-19T00:40:49.627984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626686+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:48.626686+0000","last_peered":"2023-11-19T00:40:48.626686+0000","last_clean":"2023-11-19T00:40:48.626686+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:48.626686+0000","last_undegraded":"2023-11-19T00:40:48.626686+0000","last_fullsized":"2023-11-19T00:40:48.626686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628153+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:49.628153+0000","last_peered":"2023-11-19T00:40:49.628153+0000","last_clean":"2023-11-19T00:40:49.628153+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:49.628153+0000","last_undegraded":"2023-11-19T00:40:49.628153+0000","last_fullsized":"2023-11-19T00:40:49.628153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":669,"reported_epoch":73,"state":"active+undersized+remapped","last_fresh":"2023-11-19T00:40:48.638425+0000","last_change":"2023-11-19T00:40:48.638583+0000","last_active":"2023-11-19T00:40:48.638425+0000","last_peered":"2023-11-19T00:40:48.638425+0000","last_clean":"2023-11-19T00:40:32.513875+0000","last_became_active":"2023-11-19T00:40:47.637497+0000","last_became_peered":"2023-11-19T00:40:47.637497+0000","last_unstale":"2023-11-19T00:40:48.638425+0000","last_undegraded":"2023-11-19T00:40:48.638425+0000","last_fullsized":"2023-11-19T00:40:47.622233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:49.502796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":61}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650608+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:49.650608+0000","last_peered":"2023-11-19T00:40:49.650608+0000","last_clean":"2023-11-19T00:40:49.650608+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:49.650608+0000","last_undegraded":"2023-11-19T00:40:49.650608+0000","last_fullsized":"2023-11-19T00:40:49.650608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:27.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828155+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:50.828155+0000","last_peered":"2023-11-19T00:40:50.828155+0000","last_clean":"2023-11-19T00:40:50.828155+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:50.828155+0000","last_undegraded":"2023-11-19T00:40:50.828155+0000","last_fullsized":"2023-11-19T00:40:50.828155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:37:55.011970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":453,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.632364+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:48.632364+0000","last_peered":"2023-11-19T00:40:48.632364+0000","last_clean":"2023-11-19T00:40:48.632364+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:48.632364+0000","last_undegraded":"2023-11-19T00:40:48.632364+0000","last_fullsized":"2023-11-19T00:40:48.632364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828779+0000","last_change":"2023-11-19T00:40:49.644207+0000","last_active":"2023-11-19T00:40:50.828779+0000","last_peered":"2023-11-19T00:40:50.828779+0000","last_clean":"2023-11-19T00:40:50.828779+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:40:50.828779+0000","last_undegraded":"2023-11-19T00:40:50.828779+0000","last_fullsized":"2023-11-19T00:40:50.828779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:09.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.630059+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:48.630059+0000","last_peered":"2023-11-19T00:40:48.630059+0000","last_clean":"2023-11-19T00:40:48.630059+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:48.630059+0000","last_undegraded":"2023-11-19T00:40:48.630059+0000","last_fullsized":"2023-11-19T00:40:48.630059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":241,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639279+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:49.639279+0000","last_peered":"2023-11-19T00:40:49.639279+0000","last_clean":"2023-11-19T00:40:49.639279+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:49.639279+0000","last_undegraded":"2023-11-19T00:40:49.639279+0000","last_fullsized":"2023-11-19T00:40:49.639279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:39.542692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626047+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:48.626047+0000","last_peered":"2023-11-19T00:40:48.626047+0000","last_clean":"2023-11-19T00:40:48.626047+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:48.626047+0000","last_undegraded":"2023-11-19T00:40:48.626047+0000","last_fullsized":"2023-11-19T00:40:48.626047+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628872+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:49.628872+0000","last_peered":"2023-11-19T00:40:49.628872+0000","last_clean":"2023-11-19T00:40:49.628872+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:49.628872+0000","last_undegraded":"2023-11-19T00:40:49.628872+0000","last_fullsized":"2023-11-19T00:40:49.628872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623294+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:47.623294+0000","last_peered":"2023-11-19T00:40:47.623294+0000","last_clean":"2023-11-19T00:40:47.623294+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:47.623294+0000","last_undegraded":"2023-11-19T00:40:47.623294+0000","last_fullsized":"2023-11-19T00:40:47.623294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626266+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:48.626266+0000","last_peered":"2023-11-19T00:40:48.626266+0000","last_clean":"2023-11-19T00:40:48.626266+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:48.626266+0000","last_undegraded":"2023-11-19T00:40:48.626266+0000","last_fullsized":"2023-11-19T00:40:48.626266+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":221,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.637978+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:48.637978+0000","last_peered":"2023-11-19T00:40:48.637978+0000","last_clean":"2023-11-19T00:40:48.637978+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:48.637978+0000","last_undegraded":"2023-11-19T00:40:48.637978+0000","last_fullsized":"2023-11-19T00:40:48.637978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.628812+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:48.628812+0000","last_peered":"2023-11-19T00:40:48.628812+0000","last_clean":"2023-11-19T00:40:48.628812+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:48.628812+0000","last_undegraded":"2023-11-19T00:40:48.628812+0000","last_fullsized":"2023-11-19T00:40:48.628812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637789+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:49.637789+0000","last_peered":"2023-11-19T00:40:49.637789+0000","last_clean":"2023-11-19T00:40:49.637789+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:49.637789+0000","last_undegraded":"2023-11-19T00:40:49.637789+0000","last_fullsized":"2023-11-19T00:40:49.637789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:54.815254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":222,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627863+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:49.627863+0000","last_peered":"2023-11-19T00:40:49.627863+0000","last_clean":"2023-11-19T00:40:49.627863+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:49.627863+0000","last_undegraded":"2023-11-19T00:40:49.627863+0000","last_fullsized":"2023-11-19T00:40:49.627863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":457,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638278+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:40:49.638278+0000","last_peered":"2023-11-19T00:40:49.638278+0000","last_clean":"2023-11-19T00:40:49.638278+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:40:49.638278+0000","last_undegraded":"2023-11-19T00:40:49.638278+0000","last_fullsized":"2023-11-19T00:40:49.638278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:51.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637727+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:40:49.637727+0000","last_peered":"2023-11-19T00:40:49.637727+0000","last_clean":"2023-11-19T00:40:49.637727+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:40:49.637727+0000","last_undegraded":"2023-11-19T00:40:49.637727+0000","last_fullsized":"2023-11-19T00:40:49.637727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":618,"reported_epoch":72,"state":"peering","last_fresh":"2023-11-19T00:40:48.497187+0000","last_change":"2023-11-19T00:40:48.629821+0000","last_active":"2023-11-19T00:40:48.629821+0000","last_peered":"2023-11-19T00:40:48.497187+0000","last_clean":"2023-11-19T00:40:44.700200+0000","last_became_active":"2023-11-19T00:40:47.637659+0000","last_became_peered":"2023-11-19T00:40:47.637659+0000","last_unstale":"2023-11-19T00:40:48.497187+0000","last_undegraded":"2023-11-19T00:40:48.497187+0000","last_fullsized":"2023-11-19T00:40:47.621973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:49.628637+0000","last_peered":"2023-11-19T00:40:49.628637+0000","last_clean":"2023-11-19T00:40:49.628637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:49.628637+0000","last_undegraded":"2023-11-19T00:40:49.628637+0000","last_fullsized":"2023-11-19T00:40:49.628637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.648800+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:40:49.648800+0000","last_peered":"2023-11-19T00:40:49.648800+0000","last_clean":"2023-11-19T00:40:49.648800+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:40:49.648800+0000","last_undegraded":"2023-11-19T00:40:49.648800+0000","last_fullsized":"2023-11-19T00:40:49.648800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:26:07.616172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":235,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.620911+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:47.620911+0000","last_peered":"2023-11-19T00:40:47.620911+0000","last_clean":"2023-11-19T00:40:47.620911+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:47.620911+0000","last_undegraded":"2023-11-19T00:40:47.620911+0000","last_fullsized":"2023-11-19T00:40:47.620911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.622437+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:47.622437+0000","last_peered":"2023-11-19T00:40:47.622437+0000","last_clean":"2023-11-19T00:40:47.622437+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:47.622437+0000","last_undegraded":"2023-11-19T00:40:47.622437+0000","last_fullsized":"2023-11-19T00:40:47.622437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":440,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.632255+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:48.632255+0000","last_peered":"2023-11-19T00:40:48.632255+0000","last_clean":"2023-11-19T00:40:48.632255+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:48.632255+0000","last_undegraded":"2023-11-19T00:40:48.632255+0000","last_fullsized":"2023-11-19T00:40:48.632255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628701+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:49.628701+0000","last_peered":"2023-11-19T00:40:49.628701+0000","last_clean":"2023-11-19T00:40:49.628701+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:49.628701+0000","last_undegraded":"2023-11-19T00:40:49.628701+0000","last_fullsized":"2023-11-19T00:40:49.628701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":70,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.625567+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:47.625567+0000","last_peered":"2023-11-19T00:40:47.625567+0000","last_clean":"2023-11-19T00:40:47.625567+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:47.625567+0000","last_undegraded":"2023-11-19T00:40:47.625567+0000","last_fullsized":"2023-11-19T00:40:47.625567+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":219,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.627725+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:48.627725+0000","last_peered":"2023-11-19T00:40:48.627725+0000","last_clean":"2023-11-19T00:40:48.627725+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:48.627725+0000","last_undegraded":"2023-11-19T00:40:48.627725+0000","last_fullsized":"2023-11-19T00:40:48.627725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.626409+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:48.626409+0000","last_peered":"2023-11-19T00:40:48.626409+0000","last_clean":"2023-11-19T00:40:48.626409+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:48.626409+0000","last_undegraded":"2023-11-19T00:40:48.626409+0000","last_fullsized":"2023-11-19T00:40:48.626409+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":238,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627896+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:49.627896+0000","last_peered":"2023-11-19T00:40:49.627896+0000","last_clean":"2023-11-19T00:40:49.627896+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:49.627896+0000","last_undegraded":"2023-11-19T00:40:49.627896+0000","last_fullsized":"2023-11-19T00:40:49.627896+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628582+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:49.628582+0000","last_peered":"2023-11-19T00:40:49.628582+0000","last_clean":"2023-11-19T00:40:49.628582+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:49.628582+0000","last_undegraded":"2023-11-19T00:40:49.628582+0000","last_fullsized":"2023-11-19T00:40:49.628582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":687,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647554+0000","last_change":"2023-11-19T00:40:49.647066+0000","last_active":"2023-11-19T00:40:49.647554+0000","last_peered":"2023-11-19T00:40:49.647554+0000","last_clean":"2023-11-19T00:40:49.647554+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:40:49.647554+0000","last_undegraded":"2023-11-19T00:40:49.647554+0000","last_fullsized":"2023-11-19T00:40:49.647554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:51:07.279809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628388+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:49.628388+0000","last_peered":"2023-11-19T00:40:49.628388+0000","last_clean":"2023-11-19T00:40:49.628388+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:49.628388+0000","last_undegraded":"2023-11-19T00:40:49.628388+0000","last_fullsized":"2023-11-19T00:40:49.628388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":189,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649532+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:40:49.649532+0000","last_peered":"2023-11-19T00:40:49.649532+0000","last_clean":"2023-11-19T00:40:49.649532+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:40:49.649532+0000","last_undegraded":"2023-11-19T00:40:49.649532+0000","last_fullsized":"2023-11-19T00:40:49.649532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:25.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650896+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:40:49.650896+0000","last_peered":"2023-11-19T00:40:49.650896+0000","last_clean":"2023-11-19T00:40:49.650896+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:40:49.650896+0000","last_undegraded":"2023-11-19T00:40:49.650896+0000","last_fullsized":"2023-11-19T00:40:49.650896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:30.721704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":212,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650648+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:40:49.650648+0000","last_peered":"2023-11-19T00:40:49.650648+0000","last_clean":"2023-11-19T00:40:49.650648+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:40:49.650648+0000","last_undegraded":"2023-11-19T00:40:49.650648+0000","last_fullsized":"2023-11-19T00:40:49.650648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628523+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:49.628523+0000","last_peered":"2023-11-19T00:40:49.628523+0000","last_clean":"2023-11-19T00:40:49.628523+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:49.628523+0000","last_undegraded":"2023-11-19T00:40:49.628523+0000","last_fullsized":"2023-11-19T00:40:49.628523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627815+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:49.627815+0000","last_peered":"2023-11-19T00:40:49.627815+0000","last_clean":"2023-11-19T00:40:49.627815+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:49.627815+0000","last_undegraded":"2023-11-19T00:40:49.627815+0000","last_fullsized":"2023-11-19T00:40:49.627815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":69,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-19T00:40:47.623329+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:47.623329+0000","last_peered":"2023-11-19T00:40:47.623329+0000","last_clean":"2023-11-19T00:40:47.623329+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:47.623329+0000","last_undegraded":"2023-11-19T00:40:47.623329+0000","last_fullsized":"2023-11-19T00:40:47.623329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":503,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646542+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:40:49.646542+0000","last_peered":"2023-11-19T00:40:49.646542+0000","last_clean":"2023-11-19T00:40:49.646542+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:40:49.646542+0000","last_undegraded":"2023-11-19T00:40:49.646542+0000","last_fullsized":"2023-11-19T00:40:49.646542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:11.509410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-19T00:40:48.629149+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:48.629149+0000","last_peered":"2023-11-19T00:40:48.629149+0000","last_clean":"2023-11-19T00:40:48.629149+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:48.629149+0000","last_undegraded":"2023-11-19T00:40:48.629149+0000","last_fullsized":"2023-11-19T00:40:48.629149+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76038144,"data_stored":55588760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41048395,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":429,"num_write_kb":40612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86364160,"data_stored":86291788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106896,"kb_used_data":53504,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94264944,"statfs":{"total":96636764160,"available":96527302656,"internally_reserved":0,"allocated":54788096,"data_stored":46798481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738401,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101756,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270084,"statfs":{"total":96636764160,"available":96532566016,"internally_reserved":0,"allocated":53784576,"data_stored":46883073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.55300000000000005}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.65500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738399,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113292,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.184},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.20499999999999999}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.313},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.28299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24293376,"data_stored":24271019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32659787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29827072,"data_stored":22231433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:40:57.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:40:57.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:57.316 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:40:57.326 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2023-11-19T00:40:57.048020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10821,"ondisk_log_size":10821,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314048,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801472,"statfs":{"total":289910292480,"available":289588707328,"internally_reserved":0,"allocated":157564928,"data_stored":136309863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":111061,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":-417,"num_objects_misplaced":-373,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1135,"num_bytes_recovered":11973294,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001881"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628335+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:49.628335+0000","last_peered":"2023-11-19T00:40:49.628335+0000","last_clean":"2023-11-19T00:40:49.628335+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:49.628335+0000","last_undegraded":"2023-11-19T00:40:49.628335+0000","last_fullsized":"2023-11-19T00:40:49.628335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":225,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627893+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:49.627893+0000","last_peered":"2023-11-19T00:40:49.627893+0000","last_clean":"2023-11-19T00:40:49.627893+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:49.627893+0000","last_undegraded":"2023-11-19T00:40:49.627893+0000","last_fullsized":"2023-11-19T00:40:49.627893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641372+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:49.641372+0000","last_peered":"2023-11-19T00:40:49.641372+0000","last_clean":"2023-11-19T00:40:49.641372+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:49.641372+0000","last_undegraded":"2023-11-19T00:40:49.641372+0000","last_fullsized":"2023-11-19T00:40:49.641372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:12.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650672+0000","last_change":"2023-11-19T00:40:49.649721+0000","last_active":"2023-11-19T00:40:49.650672+0000","last_peered":"2023-11-19T00:40:49.650672+0000","last_clean":"2023-11-19T00:40:49.650672+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:40:49.650672+0000","last_undegraded":"2023-11-19T00:40:49.650672+0000","last_fullsized":"2023-11-19T00:40:49.650672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:37.114888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":497,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632731+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:50.632731+0000","last_peered":"2023-11-19T00:40:50.632731+0000","last_clean":"2023-11-19T00:40:50.632731+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:50.632731+0000","last_undegraded":"2023-11-19T00:40:50.632731+0000","last_fullsized":"2023-11-19T00:40:50.632731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:47.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":452,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650631+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:40:49.650631+0000","last_peered":"2023-11-19T00:40:49.650631+0000","last_clean":"2023-11-19T00:40:49.650631+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:40:49.650631+0000","last_undegraded":"2023-11-19T00:40:49.650631+0000","last_fullsized":"2023-11-19T00:40:49.650631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:58.153284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646821+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:40:49.646821+0000","last_peered":"2023-11-19T00:40:49.646821+0000","last_clean":"2023-11-19T00:40:49.646821+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:40:49.646821+0000","last_undegraded":"2023-11-19T00:40:49.646821+0000","last_fullsized":"2023-11-19T00:40:49.646821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:27.819649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":367,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646895+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:40:49.646895+0000","last_peered":"2023-11-19T00:40:49.646895+0000","last_clean":"2023-11-19T00:40:49.646895+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:40:49.646895+0000","last_undegraded":"2023-11-19T00:40:49.646895+0000","last_fullsized":"2023-11-19T00:40:49.646895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:28:17.058785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":236,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643199+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:49.643199+0000","last_peered":"2023-11-19T00:40:49.643199+0000","last_clean":"2023-11-19T00:40:49.643199+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:49.643199+0000","last_undegraded":"2023-11-19T00:40:49.643199+0000","last_fullsized":"2023-11-19T00:40:49.643199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.644989+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:49.644989+0000","last_peered":"2023-11-19T00:40:49.644989+0000","last_clean":"2023-11-19T00:40:49.644989+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:49.644989+0000","last_undegraded":"2023-11-19T00:40:49.644989+0000","last_fullsized":"2023-11-19T00:40:49.644989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:44:32.870644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":454,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.645206+0000","last_change":"2023-11-19T00:40:49.644469+0000","last_active":"2023-11-19T00:40:49.645206+0000","last_peered":"2023-11-19T00:40:49.645206+0000","last_clean":"2023-11-19T00:40:49.645206+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:40:49.645206+0000","last_undegraded":"2023-11-19T00:40:49.645206+0000","last_fullsized":"2023-11-19T00:40:49.645206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":210,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628929+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:49.628929+0000","last_peered":"2023-11-19T00:40:49.628929+0000","last_clean":"2023-11-19T00:40:49.628929+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:49.628929+0000","last_undegraded":"2023-11-19T00:40:49.628929+0000","last_fullsized":"2023-11-19T00:40:49.628929+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":571,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628623+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:49.628623+0000","last_peered":"2023-11-19T00:40:49.628623+0000","last_clean":"2023-11-19T00:40:49.628623+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:49.628623+0000","last_undegraded":"2023-11-19T00:40:49.628623+0000","last_fullsized":"2023-11-19T00:40:49.628623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639473+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:40:49.639473+0000","last_peered":"2023-11-19T00:40:49.639473+0000","last_clean":"2023-11-19T00:40:49.639473+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:40:49.639473+0000","last_undegraded":"2023-11-19T00:40:49.639473+0000","last_fullsized":"2023-11-19T00:40:49.639473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:28.029932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.636177+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:40:49.636177+0000","last_peered":"2023-11-19T00:40:49.636177+0000","last_clean":"2023-11-19T00:40:49.636177+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:40:49.636177+0000","last_undegraded":"2023-11-19T00:40:49.636177+0000","last_fullsized":"2023-11-19T00:40:49.636177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:48:06.968931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":228,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646944+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:40:49.646944+0000","last_peered":"2023-11-19T00:40:49.646944+0000","last_clean":"2023-11-19T00:40:49.646944+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:40:49.646944+0000","last_undegraded":"2023-11-19T00:40:49.646944+0000","last_fullsized":"2023-11-19T00:40:49.646944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:51.342591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643466+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:49.643466+0000","last_peered":"2023-11-19T00:40:49.643466+0000","last_clean":"2023-11-19T00:40:49.643466+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:49.643466+0000","last_undegraded":"2023-11-19T00:40:49.643466+0000","last_fullsized":"2023-11-19T00:40:49.643466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628168+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:49.628168+0000","last_peered":"2023-11-19T00:40:49.628168+0000","last_clean":"2023-11-19T00:40:49.628168+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:49.628168+0000","last_undegraded":"2023-11-19T00:40:49.628168+0000","last_fullsized":"2023-11-19T00:40:49.628168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":416,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630248+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:49.630248+0000","last_peered":"2023-11-19T00:40:49.630248+0000","last_clean":"2023-11-19T00:40:49.630248+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:49.630248+0000","last_undegraded":"2023-11-19T00:40:49.630248+0000","last_fullsized":"2023-11-19T00:40:49.630248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":213,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650928+0000","last_change":"2023-11-19T00:40:49.650228+0000","last_active":"2023-11-19T00:40:49.650928+0000","last_peered":"2023-11-19T00:40:49.650928+0000","last_clean":"2023-11-19T00:40:49.650928+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:40:49.650928+0000","last_undegraded":"2023-11-19T00:40:49.650928+0000","last_fullsized":"2023-11-19T00:40:49.650928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649923+0000","last_change":"2023-11-19T00:40:49.648626+0000","last_active":"2023-11-19T00:40:49.649923+0000","last_peered":"2023-11-19T00:40:49.649923+0000","last_clean":"2023-11-19T00:40:49.649923+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:40:49.649923+0000","last_undegraded":"2023-11-19T00:40:49.649923+0000","last_fullsized":"2023-11-19T00:40:49.649923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627938+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:49.627938+0000","last_peered":"2023-11-19T00:40:49.627938+0000","last_clean":"2023-11-19T00:40:49.627938+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:49.627938+0000","last_undegraded":"2023-11-19T00:40:49.627938+0000","last_fullsized":"2023-11-19T00:40:49.627938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":218,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630008+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:49.630008+0000","last_peered":"2023-11-19T00:40:49.630008+0000","last_clean":"2023-11-19T00:40:49.630008+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:49.630008+0000","last_undegraded":"2023-11-19T00:40:49.630008+0000","last_fullsized":"2023-11-19T00:40:49.630008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":217,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628849+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:50.628849+0000","last_peered":"2023-11-19T00:40:50.628849+0000","last_clean":"2023-11-19T00:40:50.628849+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:50.628849+0000","last_undegraded":"2023-11-19T00:40:50.628849+0000","last_fullsized":"2023-11-19T00:40:50.628849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":248,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628440+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:49.628440+0000","last_peered":"2023-11-19T00:40:49.628440+0000","last_clean":"2023-11-19T00:40:49.628440+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:49.628440+0000","last_undegraded":"2023-11-19T00:40:49.628440+0000","last_fullsized":"2023-11-19T00:40:49.628440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":252,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643028+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:49.643028+0000","last_peered":"2023-11-19T00:40:49.643028+0000","last_clean":"2023-11-19T00:40:49.643028+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:49.643028+0000","last_undegraded":"2023-11-19T00:40:49.643028+0000","last_fullsized":"2023-11-19T00:40:49.643028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":220,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828300+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:50.828300+0000","last_peered":"2023-11-19T00:40:50.828300+0000","last_clean":"2023-11-19T00:40:50.828300+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:50.828300+0000","last_undegraded":"2023-11-19T00:40:50.828300+0000","last_fullsized":"2023-11-19T00:40:50.828300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:20.062298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628704+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:49.628704+0000","last_peered":"2023-11-19T00:40:49.628704+0000","last_clean":"2023-11-19T00:40:49.628704+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:49.628704+0000","last_undegraded":"2023-11-19T00:40:49.628704+0000","last_fullsized":"2023-11-19T00:40:49.628704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":668,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632079+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:50.632079+0000","last_peered":"2023-11-19T00:40:50.632079+0000","last_clean":"2023-11-19T00:40:50.632079+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:50.632079+0000","last_undegraded":"2023-11-19T00:40:50.632079+0000","last_fullsized":"2023-11-19T00:40:50.632079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:27:44.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628930+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:50.628930+0000","last_peered":"2023-11-19T00:40:50.628930+0000","last_clean":"2023-11-19T00:40:50.628930+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:50.628930+0000","last_undegraded":"2023-11-19T00:40:50.628930+0000","last_fullsized":"2023-11-19T00:40:50.628930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":770,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628739+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:50.628739+0000","last_peered":"2023-11-19T00:40:50.628739+0000","last_clean":"2023-11-19T00:40:50.628739+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:50.628739+0000","last_undegraded":"2023-11-19T00:40:50.628739+0000","last_fullsized":"2023-11-19T00:40:50.628739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:56:57.316040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":232,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646921+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:49.646921+0000","last_peered":"2023-11-19T00:40:49.646921+0000","last_clean":"2023-11-19T00:40:49.646921+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:49.646921+0000","last_undegraded":"2023-11-19T00:40:49.646921+0000","last_fullsized":"2023-11-19T00:40:49.646921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:41.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":403,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632086+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:50.632086+0000","last_peered":"2023-11-19T00:40:50.632086+0000","last_clean":"2023-11-19T00:40:50.632086+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:50.632086+0000","last_undegraded":"2023-11-19T00:40:50.632086+0000","last_fullsized":"2023-11-19T00:40:50.632086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:05.688454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'138","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828060+0000","last_change":"2023-11-19T00:40:49.648913+0000","last_active":"2023-11-19T00:40:50.828060+0000","last_peered":"2023-11-19T00:40:50.828060+0000","last_clean":"2023-11-19T00:40:50.828060+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:40:50.828060+0000","last_undegraded":"2023-11-19T00:40:50.828060+0000","last_fullsized":"2023-11-19T00:40:50.828060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:46.312569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.632567+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:49.632567+0000","last_peered":"2023-11-19T00:40:49.632567+0000","last_clean":"2023-11-19T00:40:49.632567+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:49.632567+0000","last_undegraded":"2023-11-19T00:40:49.632567+0000","last_fullsized":"2023-11-19T00:40:49.632567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:46.760399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643013+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:49.643013+0000","last_peered":"2023-11-19T00:40:49.643013+0000","last_clean":"2023-11-19T00:40:49.643013+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:49.643013+0000","last_undegraded":"2023-11-19T00:40:49.643013+0000","last_fullsized":"2023-11-19T00:40:49.643013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643410+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:49.643410+0000","last_peered":"2023-11-19T00:40:49.643410+0000","last_clean":"2023-11-19T00:40:49.643410+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:49.643410+0000","last_undegraded":"2023-11-19T00:40:49.643410+0000","last_fullsized":"2023-11-19T00:40:49.643410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627575+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:49.627575+0000","last_peered":"2023-11-19T00:40:49.627575+0000","last_clean":"2023-11-19T00:40:49.627575+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:49.627575+0000","last_undegraded":"2023-11-19T00:40:49.627575+0000","last_fullsized":"2023-11-19T00:40:49.627575+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631291+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:49.631291+0000","last_peered":"2023-11-19T00:40:49.631291+0000","last_clean":"2023-11-19T00:40:49.631291+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:49.631291+0000","last_undegraded":"2023-11-19T00:40:49.631291+0000","last_fullsized":"2023-11-19T00:40:49.631291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":98,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638935+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:40:49.638935+0000","last_peered":"2023-11-19T00:40:49.638935+0000","last_clean":"2023-11-19T00:40:49.638935+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:40:49.638935+0000","last_undegraded":"2023-11-19T00:40:49.638935+0000","last_fullsized":"2023-11-19T00:40:49.638935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638412+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:40:49.638412+0000","last_peered":"2023-11-19T00:40:49.638412+0000","last_clean":"2023-11-19T00:40:49.638412+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:40:49.638412+0000","last_undegraded":"2023-11-19T00:40:49.638412+0000","last_fullsized":"2023-11-19T00:40:49.638412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:07.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628327+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:49.628327+0000","last_peered":"2023-11-19T00:40:49.628327+0000","last_clean":"2023-11-19T00:40:49.628327+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:49.628327+0000","last_undegraded":"2023-11-19T00:40:49.628327+0000","last_fullsized":"2023-11-19T00:40:49.628327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627344+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:49.627344+0000","last_peered":"2023-11-19T00:40:49.627344+0000","last_clean":"2023-11-19T00:40:49.627344+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:49.627344+0000","last_undegraded":"2023-11-19T00:40:49.627344+0000","last_fullsized":"2023-11-19T00:40:49.627344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639843+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:40:49.639843+0000","last_peered":"2023-11-19T00:40:49.639843+0000","last_clean":"2023-11-19T00:40:49.639843+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:40:49.639843+0000","last_undegraded":"2023-11-19T00:40:49.639843+0000","last_fullsized":"2023-11-19T00:40:49.639843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:51.721484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":414,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827964+0000","last_change":"2023-11-19T00:40:49.645680+0000","last_active":"2023-11-19T00:40:50.827964+0000","last_peered":"2023-11-19T00:40:50.827964+0000","last_clean":"2023-11-19T00:40:50.827964+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:40:50.827964+0000","last_undegraded":"2023-11-19T00:40:50.827964+0000","last_fullsized":"2023-11-19T00:40:50.827964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:13:29.817706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650913+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:40:49.650913+0000","last_peered":"2023-11-19T00:40:49.650913+0000","last_clean":"2023-11-19T00:40:49.650913+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:40:49.650913+0000","last_undegraded":"2023-11-19T00:40:49.650913+0000","last_fullsized":"2023-11-19T00:40:49.650913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:16.205545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643393+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:49.643393+0000","last_peered":"2023-11-19T00:40:49.643393+0000","last_clean":"2023-11-19T00:40:49.643393+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:49.643393+0000","last_undegraded":"2023-11-19T00:40:49.643393+0000","last_fullsized":"2023-11-19T00:40:49.643393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643651+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:49.643651+0000","last_peered":"2023-11-19T00:40:49.643651+0000","last_clean":"2023-11-19T00:40:49.643651+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:49.643651+0000","last_undegraded":"2023-11-19T00:40:49.643651+0000","last_fullsized":"2023-11-19T00:40:49.643651+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650873+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:40:49.650873+0000","last_peered":"2023-11-19T00:40:49.650873+0000","last_clean":"2023-11-19T00:40:49.650873+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:40:49.650873+0000","last_undegraded":"2023-11-19T00:40:49.650873+0000","last_fullsized":"2023-11-19T00:40:49.650873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:19.506460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828256+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:50.828256+0000","last_peered":"2023-11-19T00:40:50.828256+0000","last_clean":"2023-11-19T00:40:50.828256+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:50.828256+0000","last_undegraded":"2023-11-19T00:40:50.828256+0000","last_fullsized":"2023-11-19T00:40:50.828256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:32.771756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641360+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:40:49.641360+0000","last_peered":"2023-11-19T00:40:49.641360+0000","last_clean":"2023-11-19T00:40:49.641360+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:40:49.641360+0000","last_undegraded":"2023-11-19T00:40:49.641360+0000","last_fullsized":"2023-11-19T00:40:49.641360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:22.553304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628860+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:50.628860+0000","last_peered":"2023-11-19T00:40:50.628860+0000","last_clean":"2023-11-19T00:40:50.628860+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:50.628860+0000","last_undegraded":"2023-11-19T00:40:50.628860+0000","last_fullsized":"2023-11-19T00:40:50.628860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":572,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638343+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:40:49.638343+0000","last_peered":"2023-11-19T00:40:49.638343+0000","last_clean":"2023-11-19T00:40:49.638343+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:40:49.638343+0000","last_undegraded":"2023-11-19T00:40:49.638343+0000","last_fullsized":"2023-11-19T00:40:49.638343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:50.437778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627558+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:49.627558+0000","last_peered":"2023-11-19T00:40:49.627558+0000","last_clean":"2023-11-19T00:40:49.627558+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:49.627558+0000","last_undegraded":"2023-11-19T00:40:49.627558+0000","last_fullsized":"2023-11-19T00:40:49.627558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":207,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643289+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:49.643289+0000","last_peered":"2023-11-19T00:40:49.643289+0000","last_clean":"2023-11-19T00:40:49.643289+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:49.643289+0000","last_undegraded":"2023-11-19T00:40:49.643289+0000","last_fullsized":"2023-11-19T00:40:49.643289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":306,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638672+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:49.638672+0000","last_peered":"2023-11-19T00:40:49.638672+0000","last_clean":"2023-11-19T00:40:49.638672+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:49.638672+0000","last_undegraded":"2023-11-19T00:40:49.638672+0000","last_fullsized":"2023-11-19T00:40:49.638672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:51.392980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650550+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:49.650550+0000","last_peered":"2023-11-19T00:40:49.650550+0000","last_clean":"2023-11-19T00:40:49.650550+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:49.650550+0000","last_undegraded":"2023-11-19T00:40:49.650550+0000","last_fullsized":"2023-11-19T00:40:49.650550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:44.483221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638914+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:49.638914+0000","last_peered":"2023-11-19T00:40:49.638914+0000","last_clean":"2023-11-19T00:40:49.638914+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:49.638914+0000","last_undegraded":"2023-11-19T00:40:49.638914+0000","last_fullsized":"2023-11-19T00:40:49.638914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:57.791481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":427,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828679+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:50.828679+0000","last_peered":"2023-11-19T00:40:50.828679+0000","last_clean":"2023-11-19T00:40:50.828679+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:50.828679+0000","last_undegraded":"2023-11-19T00:40:50.828679+0000","last_fullsized":"2023-11-19T00:40:50.828679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:02.150359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638326+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:49.638326+0000","last_peered":"2023-11-19T00:40:49.638326+0000","last_clean":"2023-11-19T00:40:49.638326+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:49.638326+0000","last_undegraded":"2023-11-19T00:40:49.638326+0000","last_fullsized":"2023-11-19T00:40:49.638326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:03:04.935661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630239+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:49.630239+0000","last_peered":"2023-11-19T00:40:49.630239+0000","last_clean":"2023-11-19T00:40:49.630239+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:49.630239+0000","last_undegraded":"2023-11-19T00:40:49.630239+0000","last_fullsized":"2023-11-19T00:40:49.630239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629568+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:50.629568+0000","last_peered":"2023-11-19T00:40:50.629568+0000","last_clean":"2023-11-19T00:40:50.629568+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:50.629568+0000","last_undegraded":"2023-11-19T00:40:50.629568+0000","last_fullsized":"2023-11-19T00:40:50.629568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630478+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:49.630478+0000","last_peered":"2023-11-19T00:40:49.630478+0000","last_clean":"2023-11-19T00:40:49.630478+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:49.630478+0000","last_undegraded":"2023-11-19T00:40:49.630478+0000","last_fullsized":"2023-11-19T00:40:49.630478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628153+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:49.628153+0000","last_peered":"2023-11-19T00:40:49.628153+0000","last_clean":"2023-11-19T00:40:49.628153+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:49.628153+0000","last_undegraded":"2023-11-19T00:40:49.628153+0000","last_fullsized":"2023-11-19T00:40:49.628153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":678,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.631868+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:50.631868+0000","last_peered":"2023-11-19T00:40:50.631868+0000","last_clean":"2023-11-19T00:40:50.631868+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:50.631868+0000","last_undegraded":"2023-11-19T00:40:50.631868+0000","last_fullsized":"2023-11-19T00:40:50.631868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:52:28.650242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650608+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:49.650608+0000","last_peered":"2023-11-19T00:40:49.650608+0000","last_clean":"2023-11-19T00:40:49.650608+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:49.650608+0000","last_undegraded":"2023-11-19T00:40:49.650608+0000","last_fullsized":"2023-11-19T00:40:49.650608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:27.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828155+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:50.828155+0000","last_peered":"2023-11-19T00:40:50.828155+0000","last_clean":"2023-11-19T00:40:50.828155+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:50.828155+0000","last_undegraded":"2023-11-19T00:40:50.828155+0000","last_fullsized":"2023-11-19T00:40:50.828155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:37:55.011970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":455,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630841+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:49.630841+0000","last_peered":"2023-11-19T00:40:49.630841+0000","last_clean":"2023-11-19T00:40:49.630841+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:49.630841+0000","last_undegraded":"2023-11-19T00:40:49.630841+0000","last_fullsized":"2023-11-19T00:40:49.630841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828779+0000","last_change":"2023-11-19T00:40:49.644207+0000","last_active":"2023-11-19T00:40:50.828779+0000","last_peered":"2023-11-19T00:40:50.828779+0000","last_clean":"2023-11-19T00:40:50.828779+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:40:50.828779+0000","last_undegraded":"2023-11-19T00:40:50.828779+0000","last_fullsized":"2023-11-19T00:40:50.828779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:09.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643658+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:49.643658+0000","last_peered":"2023-11-19T00:40:49.643658+0000","last_clean":"2023-11-19T00:40:49.643658+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:49.643658+0000","last_undegraded":"2023-11-19T00:40:49.643658+0000","last_fullsized":"2023-11-19T00:40:49.643658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":241,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639279+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:49.639279+0000","last_peered":"2023-11-19T00:40:49.639279+0000","last_clean":"2023-11-19T00:40:49.639279+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:49.639279+0000","last_undegraded":"2023-11-19T00:40:49.639279+0000","last_fullsized":"2023-11-19T00:40:49.639279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:39.542692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630701+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:49.630701+0000","last_peered":"2023-11-19T00:40:49.630701+0000","last_clean":"2023-11-19T00:40:49.630701+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:49.630701+0000","last_undegraded":"2023-11-19T00:40:49.630701+0000","last_fullsized":"2023-11-19T00:40:49.630701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628872+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:49.628872+0000","last_peered":"2023-11-19T00:40:49.628872+0000","last_clean":"2023-11-19T00:40:49.628872+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:49.628872+0000","last_undegraded":"2023-11-19T00:40:49.628872+0000","last_fullsized":"2023-11-19T00:40:49.628872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.630083+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:50.630083+0000","last_peered":"2023-11-19T00:40:50.630083+0000","last_clean":"2023-11-19T00:40:50.630083+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:50.630083+0000","last_undegraded":"2023-11-19T00:40:50.630083+0000","last_fullsized":"2023-11-19T00:40:50.630083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630656+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:49.630656+0000","last_peered":"2023-11-19T00:40:49.630656+0000","last_clean":"2023-11-19T00:40:49.630656+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:49.630656+0000","last_undegraded":"2023-11-19T00:40:49.630656+0000","last_fullsized":"2023-11-19T00:40:49.630656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":223,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:49.629529+0000","last_peered":"2023-11-19T00:40:49.629529+0000","last_clean":"2023-11-19T00:40:49.629529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:49.629529+0000","last_undegraded":"2023-11-19T00:40:49.629529+0000","last_fullsized":"2023-11-19T00:40:49.629529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643295+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:49.643295+0000","last_peered":"2023-11-19T00:40:49.643295+0000","last_clean":"2023-11-19T00:40:49.643295+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:49.643295+0000","last_undegraded":"2023-11-19T00:40:49.643295+0000","last_fullsized":"2023-11-19T00:40:49.643295+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637789+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:49.637789+0000","last_peered":"2023-11-19T00:40:49.637789+0000","last_clean":"2023-11-19T00:40:49.637789+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:49.637789+0000","last_undegraded":"2023-11-19T00:40:49.637789+0000","last_fullsized":"2023-11-19T00:40:49.637789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:54.815254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":222,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627863+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:49.627863+0000","last_peered":"2023-11-19T00:40:49.627863+0000","last_clean":"2023-11-19T00:40:49.627863+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:49.627863+0000","last_undegraded":"2023-11-19T00:40:49.627863+0000","last_fullsized":"2023-11-19T00:40:49.627863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":457,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638278+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:40:49.638278+0000","last_peered":"2023-11-19T00:40:49.638278+0000","last_clean":"2023-11-19T00:40:49.638278+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:40:49.638278+0000","last_undegraded":"2023-11-19T00:40:49.638278+0000","last_fullsized":"2023-11-19T00:40:49.638278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:51.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637727+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:40:49.637727+0000","last_peered":"2023-11-19T00:40:49.637727+0000","last_clean":"2023-11-19T00:40:49.637727+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:40:49.637727+0000","last_undegraded":"2023-11-19T00:40:49.637727+0000","last_fullsized":"2023-11-19T00:40:49.637727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":627,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647647+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:40:49.647647+0000","last_peered":"2023-11-19T00:40:49.647647+0000","last_clean":"2023-11-19T00:40:49.647647+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:40:49.647647+0000","last_undegraded":"2023-11-19T00:40:49.647647+0000","last_fullsized":"2023-11-19T00:40:49.647647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:54:12.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:49.628637+0000","last_peered":"2023-11-19T00:40:49.628637+0000","last_clean":"2023-11-19T00:40:49.628637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:49.628637+0000","last_undegraded":"2023-11-19T00:40:49.628637+0000","last_fullsized":"2023-11-19T00:40:49.628637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.648800+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:40:49.648800+0000","last_peered":"2023-11-19T00:40:49.648800+0000","last_clean":"2023-11-19T00:40:49.648800+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:40:49.648800+0000","last_undegraded":"2023-11-19T00:40:49.648800+0000","last_fullsized":"2023-11-19T00:40:49.648800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:26:07.616172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":237,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630096+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:49.630096+0000","last_peered":"2023-11-19T00:40:49.630096+0000","last_clean":"2023-11-19T00:40:49.630096+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:49.630096+0000","last_undegraded":"2023-11-19T00:40:49.630096+0000","last_fullsized":"2023-11-19T00:40:49.630096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643663+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:49.643663+0000","last_peered":"2023-11-19T00:40:49.643663+0000","last_clean":"2023-11-19T00:40:49.643663+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:49.643663+0000","last_undegraded":"2023-11-19T00:40:49.643663+0000","last_fullsized":"2023-11-19T00:40:49.643663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":442,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629589+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:49.629589+0000","last_peered":"2023-11-19T00:40:49.629589+0000","last_clean":"2023-11-19T00:40:49.629589+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:49.629589+0000","last_undegraded":"2023-11-19T00:40:49.629589+0000","last_fullsized":"2023-11-19T00:40:49.629589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628701+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:49.628701+0000","last_peered":"2023-11-19T00:40:49.628701+0000","last_clean":"2023-11-19T00:40:49.628701+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:49.628701+0000","last_undegraded":"2023-11-19T00:40:49.628701+0000","last_fullsized":"2023-11-19T00:40:49.628701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630587+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:49.630587+0000","last_peered":"2023-11-19T00:40:49.630587+0000","last_clean":"2023-11-19T00:40:49.630587+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:49.630587+0000","last_undegraded":"2023-11-19T00:40:49.630587+0000","last_fullsized":"2023-11-19T00:40:49.630587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.640059+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:49.640059+0000","last_peered":"2023-11-19T00:40:49.640059+0000","last_clean":"2023-11-19T00:40:49.640059+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:49.640059+0000","last_undegraded":"2023-11-19T00:40:49.640059+0000","last_fullsized":"2023-11-19T00:40:49.640059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630153+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:49.630153+0000","last_peered":"2023-11-19T00:40:49.630153+0000","last_clean":"2023-11-19T00:40:49.630153+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:49.630153+0000","last_undegraded":"2023-11-19T00:40:49.630153+0000","last_fullsized":"2023-11-19T00:40:49.630153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":238,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627896+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:49.627896+0000","last_peered":"2023-11-19T00:40:49.627896+0000","last_clean":"2023-11-19T00:40:49.627896+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:49.627896+0000","last_undegraded":"2023-11-19T00:40:49.627896+0000","last_fullsized":"2023-11-19T00:40:49.627896+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628582+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:49.628582+0000","last_peered":"2023-11-19T00:40:49.628582+0000","last_clean":"2023-11-19T00:40:49.628582+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:49.628582+0000","last_undegraded":"2023-11-19T00:40:49.628582+0000","last_fullsized":"2023-11-19T00:40:49.628582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":687,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647554+0000","last_change":"2023-11-19T00:40:49.647066+0000","last_active":"2023-11-19T00:40:49.647554+0000","last_peered":"2023-11-19T00:40:49.647554+0000","last_clean":"2023-11-19T00:40:49.647554+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:40:49.647554+0000","last_undegraded":"2023-11-19T00:40:49.647554+0000","last_fullsized":"2023-11-19T00:40:49.647554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:51:07.279809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628388+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:49.628388+0000","last_peered":"2023-11-19T00:40:49.628388+0000","last_clean":"2023-11-19T00:40:49.628388+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:49.628388+0000","last_undegraded":"2023-11-19T00:40:49.628388+0000","last_fullsized":"2023-11-19T00:40:49.628388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":189,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649532+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:40:49.649532+0000","last_peered":"2023-11-19T00:40:49.649532+0000","last_clean":"2023-11-19T00:40:49.649532+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:40:49.649532+0000","last_undegraded":"2023-11-19T00:40:49.649532+0000","last_fullsized":"2023-11-19T00:40:49.649532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:25.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650896+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:40:49.650896+0000","last_peered":"2023-11-19T00:40:49.650896+0000","last_clean":"2023-11-19T00:40:49.650896+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:40:49.650896+0000","last_undegraded":"2023-11-19T00:40:49.650896+0000","last_fullsized":"2023-11-19T00:40:49.650896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:30.721704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":212,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650648+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:40:49.650648+0000","last_peered":"2023-11-19T00:40:49.650648+0000","last_clean":"2023-11-19T00:40:49.650648+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:40:49.650648+0000","last_undegraded":"2023-11-19T00:40:49.650648+0000","last_fullsized":"2023-11-19T00:40:49.650648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628523+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:49.628523+0000","last_peered":"2023-11-19T00:40:49.628523+0000","last_clean":"2023-11-19T00:40:49.628523+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:49.628523+0000","last_undegraded":"2023-11-19T00:40:49.628523+0000","last_fullsized":"2023-11-19T00:40:49.628523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627815+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:49.627815+0000","last_peered":"2023-11-19T00:40:49.627815+0000","last_clean":"2023-11-19T00:40:49.627815+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:49.627815+0000","last_undegraded":"2023-11-19T00:40:49.627815+0000","last_fullsized":"2023-11-19T00:40:49.627815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643201+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:49.643201+0000","last_peered":"2023-11-19T00:40:49.643201+0000","last_clean":"2023-11-19T00:40:49.643201+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:49.643201+0000","last_undegraded":"2023-11-19T00:40:49.643201+0000","last_fullsized":"2023-11-19T00:40:49.643201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":503,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646542+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:40:49.646542+0000","last_peered":"2023-11-19T00:40:49.646542+0000","last_clean":"2023-11-19T00:40:49.646542+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:40:49.646542+0000","last_undegraded":"2023-11-19T00:40:49.646542+0000","last_fullsized":"2023-11-19T00:40:49.646542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:11.509410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631204+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:49.631204+0000","last_peered":"2023-11-19T00:40:49.631204+0000","last_clean":"2023-11-19T00:40:49.631204+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:49.631204+0000","last_undegraded":"2023-11-19T00:40:49.631204+0000","last_fullsized":"2023-11-19T00:40:49.631204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82098443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99000,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272840,"statfs":{"total":96636764160,"available":96535388160,"internally_reserved":0,"allocated":46702592,"data_stored":39130954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101756,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270084,"statfs":{"total":96636764160,"available":96532566016,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.44}]}]},{"osd":1,"up_from":8,"seq":34359738400,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113292,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20076021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:40:57.330 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-11-19T00:40:57.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2023-11-19T00:40:57.677 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-19T00:40:57.688 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-19T00:40:57.688 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:40:57.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:57.994 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:40:58.004 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2023-11-19T00:40:57.048020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10821,"ondisk_log_size":10821,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314048,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801472,"statfs":{"total":289910292480,"available":289588707328,"internally_reserved":0,"allocated":157564928,"data_stored":136309863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":111061,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":-417,"num_objects_misplaced":-373,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1135,"num_bytes_recovered":11973294,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001881"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628335+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:49.628335+0000","last_peered":"2023-11-19T00:40:49.628335+0000","last_clean":"2023-11-19T00:40:49.628335+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:49.628335+0000","last_undegraded":"2023-11-19T00:40:49.628335+0000","last_fullsized":"2023-11-19T00:40:49.628335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":225,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627893+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:49.627893+0000","last_peered":"2023-11-19T00:40:49.627893+0000","last_clean":"2023-11-19T00:40:49.627893+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:49.627893+0000","last_undegraded":"2023-11-19T00:40:49.627893+0000","last_fullsized":"2023-11-19T00:40:49.627893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641372+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:49.641372+0000","last_peered":"2023-11-19T00:40:49.641372+0000","last_clean":"2023-11-19T00:40:49.641372+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:49.641372+0000","last_undegraded":"2023-11-19T00:40:49.641372+0000","last_fullsized":"2023-11-19T00:40:49.641372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:12.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650672+0000","last_change":"2023-11-19T00:40:49.649721+0000","last_active":"2023-11-19T00:40:49.650672+0000","last_peered":"2023-11-19T00:40:49.650672+0000","last_clean":"2023-11-19T00:40:49.650672+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:40:49.650672+0000","last_undegraded":"2023-11-19T00:40:49.650672+0000","last_fullsized":"2023-11-19T00:40:49.650672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:37.114888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":497,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632731+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:50.632731+0000","last_peered":"2023-11-19T00:40:50.632731+0000","last_clean":"2023-11-19T00:40:50.632731+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:50.632731+0000","last_undegraded":"2023-11-19T00:40:50.632731+0000","last_fullsized":"2023-11-19T00:40:50.632731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:47.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":452,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650631+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:40:49.650631+0000","last_peered":"2023-11-19T00:40:49.650631+0000","last_clean":"2023-11-19T00:40:49.650631+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:40:49.650631+0000","last_undegraded":"2023-11-19T00:40:49.650631+0000","last_fullsized":"2023-11-19T00:40:49.650631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:58.153284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646821+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:40:49.646821+0000","last_peered":"2023-11-19T00:40:49.646821+0000","last_clean":"2023-11-19T00:40:49.646821+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:40:49.646821+0000","last_undegraded":"2023-11-19T00:40:49.646821+0000","last_fullsized":"2023-11-19T00:40:49.646821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:27.819649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":367,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646895+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:40:49.646895+0000","last_peered":"2023-11-19T00:40:49.646895+0000","last_clean":"2023-11-19T00:40:49.646895+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:40:49.646895+0000","last_undegraded":"2023-11-19T00:40:49.646895+0000","last_fullsized":"2023-11-19T00:40:49.646895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:28:17.058785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":236,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643199+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:49.643199+0000","last_peered":"2023-11-19T00:40:49.643199+0000","last_clean":"2023-11-19T00:40:49.643199+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:49.643199+0000","last_undegraded":"2023-11-19T00:40:49.643199+0000","last_fullsized":"2023-11-19T00:40:49.643199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.644989+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:49.644989+0000","last_peered":"2023-11-19T00:40:49.644989+0000","last_clean":"2023-11-19T00:40:49.644989+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:49.644989+0000","last_undegraded":"2023-11-19T00:40:49.644989+0000","last_fullsized":"2023-11-19T00:40:49.644989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:44:32.870644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":454,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.645206+0000","last_change":"2023-11-19T00:40:49.644469+0000","last_active":"2023-11-19T00:40:49.645206+0000","last_peered":"2023-11-19T00:40:49.645206+0000","last_clean":"2023-11-19T00:40:49.645206+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:40:49.645206+0000","last_undegraded":"2023-11-19T00:40:49.645206+0000","last_fullsized":"2023-11-19T00:40:49.645206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":210,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628929+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:49.628929+0000","last_peered":"2023-11-19T00:40:49.628929+0000","last_clean":"2023-11-19T00:40:49.628929+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:49.628929+0000","last_undegraded":"2023-11-19T00:40:49.628929+0000","last_fullsized":"2023-11-19T00:40:49.628929+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":571,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628623+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:49.628623+0000","last_peered":"2023-11-19T00:40:49.628623+0000","last_clean":"2023-11-19T00:40:49.628623+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:49.628623+0000","last_undegraded":"2023-11-19T00:40:49.628623+0000","last_fullsized":"2023-11-19T00:40:49.628623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639473+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:40:49.639473+0000","last_peered":"2023-11-19T00:40:49.639473+0000","last_clean":"2023-11-19T00:40:49.639473+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:40:49.639473+0000","last_undegraded":"2023-11-19T00:40:49.639473+0000","last_fullsized":"2023-11-19T00:40:49.639473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:28.029932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.636177+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:40:49.636177+0000","last_peered":"2023-11-19T00:40:49.636177+0000","last_clean":"2023-11-19T00:40:49.636177+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:40:49.636177+0000","last_undegraded":"2023-11-19T00:40:49.636177+0000","last_fullsized":"2023-11-19T00:40:49.636177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:48:06.968931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":228,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646944+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:40:49.646944+0000","last_peered":"2023-11-19T00:40:49.646944+0000","last_clean":"2023-11-19T00:40:49.646944+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:40:49.646944+0000","last_undegraded":"2023-11-19T00:40:49.646944+0000","last_fullsized":"2023-11-19T00:40:49.646944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:51.342591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643466+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:49.643466+0000","last_peered":"2023-11-19T00:40:49.643466+0000","last_clean":"2023-11-19T00:40:49.643466+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:49.643466+0000","last_undegraded":"2023-11-19T00:40:49.643466+0000","last_fullsized":"2023-11-19T00:40:49.643466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628168+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:49.628168+0000","last_peered":"2023-11-19T00:40:49.628168+0000","last_clean":"2023-11-19T00:40:49.628168+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:49.628168+0000","last_undegraded":"2023-11-19T00:40:49.628168+0000","last_fullsized":"2023-11-19T00:40:49.628168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":416,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630248+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:49.630248+0000","last_peered":"2023-11-19T00:40:49.630248+0000","last_clean":"2023-11-19T00:40:49.630248+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:49.630248+0000","last_undegraded":"2023-11-19T00:40:49.630248+0000","last_fullsized":"2023-11-19T00:40:49.630248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":213,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650928+0000","last_change":"2023-11-19T00:40:49.650228+0000","last_active":"2023-11-19T00:40:49.650928+0000","last_peered":"2023-11-19T00:40:49.650928+0000","last_clean":"2023-11-19T00:40:49.650928+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:40:49.650928+0000","last_undegraded":"2023-11-19T00:40:49.650928+0000","last_fullsized":"2023-11-19T00:40:49.650928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649923+0000","last_change":"2023-11-19T00:40:49.648626+0000","last_active":"2023-11-19T00:40:49.649923+0000","last_peered":"2023-11-19T00:40:49.649923+0000","last_clean":"2023-11-19T00:40:49.649923+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:40:49.649923+0000","last_undegraded":"2023-11-19T00:40:49.649923+0000","last_fullsized":"2023-11-19T00:40:49.649923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627938+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:49.627938+0000","last_peered":"2023-11-19T00:40:49.627938+0000","last_clean":"2023-11-19T00:40:49.627938+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:49.627938+0000","last_undegraded":"2023-11-19T00:40:49.627938+0000","last_fullsized":"2023-11-19T00:40:49.627938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":218,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630008+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:49.630008+0000","last_peered":"2023-11-19T00:40:49.630008+0000","last_clean":"2023-11-19T00:40:49.630008+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:49.630008+0000","last_undegraded":"2023-11-19T00:40:49.630008+0000","last_fullsized":"2023-11-19T00:40:49.630008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":217,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628849+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:50.628849+0000","last_peered":"2023-11-19T00:40:50.628849+0000","last_clean":"2023-11-19T00:40:50.628849+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:50.628849+0000","last_undegraded":"2023-11-19T00:40:50.628849+0000","last_fullsized":"2023-11-19T00:40:50.628849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":248,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628440+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:49.628440+0000","last_peered":"2023-11-19T00:40:49.628440+0000","last_clean":"2023-11-19T00:40:49.628440+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:49.628440+0000","last_undegraded":"2023-11-19T00:40:49.628440+0000","last_fullsized":"2023-11-19T00:40:49.628440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":252,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643028+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:49.643028+0000","last_peered":"2023-11-19T00:40:49.643028+0000","last_clean":"2023-11-19T00:40:49.643028+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:49.643028+0000","last_undegraded":"2023-11-19T00:40:49.643028+0000","last_fullsized":"2023-11-19T00:40:49.643028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":220,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828300+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:50.828300+0000","last_peered":"2023-11-19T00:40:50.828300+0000","last_clean":"2023-11-19T00:40:50.828300+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:50.828300+0000","last_undegraded":"2023-11-19T00:40:50.828300+0000","last_fullsized":"2023-11-19T00:40:50.828300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:20.062298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628704+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:49.628704+0000","last_peered":"2023-11-19T00:40:49.628704+0000","last_clean":"2023-11-19T00:40:49.628704+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:49.628704+0000","last_undegraded":"2023-11-19T00:40:49.628704+0000","last_fullsized":"2023-11-19T00:40:49.628704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":668,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632079+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:50.632079+0000","last_peered":"2023-11-19T00:40:50.632079+0000","last_clean":"2023-11-19T00:40:50.632079+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:50.632079+0000","last_undegraded":"2023-11-19T00:40:50.632079+0000","last_fullsized":"2023-11-19T00:40:50.632079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:27:44.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628930+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:50.628930+0000","last_peered":"2023-11-19T00:40:50.628930+0000","last_clean":"2023-11-19T00:40:50.628930+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:50.628930+0000","last_undegraded":"2023-11-19T00:40:50.628930+0000","last_fullsized":"2023-11-19T00:40:50.628930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":770,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628739+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:50.628739+0000","last_peered":"2023-11-19T00:40:50.628739+0000","last_clean":"2023-11-19T00:40:50.628739+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:50.628739+0000","last_undegraded":"2023-11-19T00:40:50.628739+0000","last_fullsized":"2023-11-19T00:40:50.628739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:56:57.316040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":232,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646921+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:49.646921+0000","last_peered":"2023-11-19T00:40:49.646921+0000","last_clean":"2023-11-19T00:40:49.646921+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:49.646921+0000","last_undegraded":"2023-11-19T00:40:49.646921+0000","last_fullsized":"2023-11-19T00:40:49.646921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:41.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":403,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632086+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:50.632086+0000","last_peered":"2023-11-19T00:40:50.632086+0000","last_clean":"2023-11-19T00:40:50.632086+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:50.632086+0000","last_undegraded":"2023-11-19T00:40:50.632086+0000","last_fullsized":"2023-11-19T00:40:50.632086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:05.688454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'138","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828060+0000","last_change":"2023-11-19T00:40:49.648913+0000","last_active":"2023-11-19T00:40:50.828060+0000","last_peered":"2023-11-19T00:40:50.828060+0000","last_clean":"2023-11-19T00:40:50.828060+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:40:50.828060+0000","last_undegraded":"2023-11-19T00:40:50.828060+0000","last_fullsized":"2023-11-19T00:40:50.828060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:46.312569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.632567+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:49.632567+0000","last_peered":"2023-11-19T00:40:49.632567+0000","last_clean":"2023-11-19T00:40:49.632567+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:49.632567+0000","last_undegraded":"2023-11-19T00:40:49.632567+0000","last_fullsized":"2023-11-19T00:40:49.632567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:46.760399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643013+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:49.643013+0000","last_peered":"2023-11-19T00:40:49.643013+0000","last_clean":"2023-11-19T00:40:49.643013+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:49.643013+0000","last_undegraded":"2023-11-19T00:40:49.643013+0000","last_fullsized":"2023-11-19T00:40:49.643013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643410+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:49.643410+0000","last_peered":"2023-11-19T00:40:49.643410+0000","last_clean":"2023-11-19T00:40:49.643410+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:49.643410+0000","last_undegraded":"2023-11-19T00:40:49.643410+0000","last_fullsized":"2023-11-19T00:40:49.643410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627575+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:49.627575+0000","last_peered":"2023-11-19T00:40:49.627575+0000","last_clean":"2023-11-19T00:40:49.627575+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:49.627575+0000","last_undegraded":"2023-11-19T00:40:49.627575+0000","last_fullsized":"2023-11-19T00:40:49.627575+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631291+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:49.631291+0000","last_peered":"2023-11-19T00:40:49.631291+0000","last_clean":"2023-11-19T00:40:49.631291+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:49.631291+0000","last_undegraded":"2023-11-19T00:40:49.631291+0000","last_fullsized":"2023-11-19T00:40:49.631291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":98,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638935+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:40:49.638935+0000","last_peered":"2023-11-19T00:40:49.638935+0000","last_clean":"2023-11-19T00:40:49.638935+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:40:49.638935+0000","last_undegraded":"2023-11-19T00:40:49.638935+0000","last_fullsized":"2023-11-19T00:40:49.638935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638412+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:40:49.638412+0000","last_peered":"2023-11-19T00:40:49.638412+0000","last_clean":"2023-11-19T00:40:49.638412+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:40:49.638412+0000","last_undegraded":"2023-11-19T00:40:49.638412+0000","last_fullsized":"2023-11-19T00:40:49.638412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:07.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628327+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:49.628327+0000","last_peered":"2023-11-19T00:40:49.628327+0000","last_clean":"2023-11-19T00:40:49.628327+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:49.628327+0000","last_undegraded":"2023-11-19T00:40:49.628327+0000","last_fullsized":"2023-11-19T00:40:49.628327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627344+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:49.627344+0000","last_peered":"2023-11-19T00:40:49.627344+0000","last_clean":"2023-11-19T00:40:49.627344+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:49.627344+0000","last_undegraded":"2023-11-19T00:40:49.627344+0000","last_fullsized":"2023-11-19T00:40:49.627344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639843+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:40:49.639843+0000","last_peered":"2023-11-19T00:40:49.639843+0000","last_clean":"2023-11-19T00:40:49.639843+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:40:49.639843+0000","last_undegraded":"2023-11-19T00:40:49.639843+0000","last_fullsized":"2023-11-19T00:40:49.639843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:51.721484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":414,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827964+0000","last_change":"2023-11-19T00:40:49.645680+0000","last_active":"2023-11-19T00:40:50.827964+0000","last_peered":"2023-11-19T00:40:50.827964+0000","last_clean":"2023-11-19T00:40:50.827964+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:40:50.827964+0000","last_undegraded":"2023-11-19T00:40:50.827964+0000","last_fullsized":"2023-11-19T00:40:50.827964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:13:29.817706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650913+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:40:49.650913+0000","last_peered":"2023-11-19T00:40:49.650913+0000","last_clean":"2023-11-19T00:40:49.650913+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:40:49.650913+0000","last_undegraded":"2023-11-19T00:40:49.650913+0000","last_fullsized":"2023-11-19T00:40:49.650913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:16.205545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643393+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:49.643393+0000","last_peered":"2023-11-19T00:40:49.643393+0000","last_clean":"2023-11-19T00:40:49.643393+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:49.643393+0000","last_undegraded":"2023-11-19T00:40:49.643393+0000","last_fullsized":"2023-11-19T00:40:49.643393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643651+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:49.643651+0000","last_peered":"2023-11-19T00:40:49.643651+0000","last_clean":"2023-11-19T00:40:49.643651+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:49.643651+0000","last_undegraded":"2023-11-19T00:40:49.643651+0000","last_fullsized":"2023-11-19T00:40:49.643651+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650873+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:40:49.650873+0000","last_peered":"2023-11-19T00:40:49.650873+0000","last_clean":"2023-11-19T00:40:49.650873+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:40:49.650873+0000","last_undegraded":"2023-11-19T00:40:49.650873+0000","last_fullsized":"2023-11-19T00:40:49.650873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:19.506460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828256+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:50.828256+0000","last_peered":"2023-11-19T00:40:50.828256+0000","last_clean":"2023-11-19T00:40:50.828256+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:50.828256+0000","last_undegraded":"2023-11-19T00:40:50.828256+0000","last_fullsized":"2023-11-19T00:40:50.828256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:32.771756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641360+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:40:49.641360+0000","last_peered":"2023-11-19T00:40:49.641360+0000","last_clean":"2023-11-19T00:40:49.641360+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:40:49.641360+0000","last_undegraded":"2023-11-19T00:40:49.641360+0000","last_fullsized":"2023-11-19T00:40:49.641360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:22.553304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628860+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:50.628860+0000","last_peered":"2023-11-19T00:40:50.628860+0000","last_clean":"2023-11-19T00:40:50.628860+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:50.628860+0000","last_undegraded":"2023-11-19T00:40:50.628860+0000","last_fullsized":"2023-11-19T00:40:50.628860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":572,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638343+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:40:49.638343+0000","last_peered":"2023-11-19T00:40:49.638343+0000","last_clean":"2023-11-19T00:40:49.638343+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:40:49.638343+0000","last_undegraded":"2023-11-19T00:40:49.638343+0000","last_fullsized":"2023-11-19T00:40:49.638343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:50.437778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627558+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:49.627558+0000","last_peered":"2023-11-19T00:40:49.627558+0000","last_clean":"2023-11-19T00:40:49.627558+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:49.627558+0000","last_undegraded":"2023-11-19T00:40:49.627558+0000","last_fullsized":"2023-11-19T00:40:49.627558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":207,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643289+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:49.643289+0000","last_peered":"2023-11-19T00:40:49.643289+0000","last_clean":"2023-11-19T00:40:49.643289+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:49.643289+0000","last_undegraded":"2023-11-19T00:40:49.643289+0000","last_fullsized":"2023-11-19T00:40:49.643289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":306,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638672+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:49.638672+0000","last_peered":"2023-11-19T00:40:49.638672+0000","last_clean":"2023-11-19T00:40:49.638672+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:49.638672+0000","last_undegraded":"2023-11-19T00:40:49.638672+0000","last_fullsized":"2023-11-19T00:40:49.638672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:51.392980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650550+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:49.650550+0000","last_peered":"2023-11-19T00:40:49.650550+0000","last_clean":"2023-11-19T00:40:49.650550+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:49.650550+0000","last_undegraded":"2023-11-19T00:40:49.650550+0000","last_fullsized":"2023-11-19T00:40:49.650550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:44.483221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638914+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:49.638914+0000","last_peered":"2023-11-19T00:40:49.638914+0000","last_clean":"2023-11-19T00:40:49.638914+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:49.638914+0000","last_undegraded":"2023-11-19T00:40:49.638914+0000","last_fullsized":"2023-11-19T00:40:49.638914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:57.791481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":427,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828679+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:50.828679+0000","last_peered":"2023-11-19T00:40:50.828679+0000","last_clean":"2023-11-19T00:40:50.828679+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:50.828679+0000","last_undegraded":"2023-11-19T00:40:50.828679+0000","last_fullsized":"2023-11-19T00:40:50.828679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:02.150359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638326+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:49.638326+0000","last_peered":"2023-11-19T00:40:49.638326+0000","last_clean":"2023-11-19T00:40:49.638326+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:49.638326+0000","last_undegraded":"2023-11-19T00:40:49.638326+0000","last_fullsized":"2023-11-19T00:40:49.638326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:03:04.935661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630239+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:49.630239+0000","last_peered":"2023-11-19T00:40:49.630239+0000","last_clean":"2023-11-19T00:40:49.630239+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:49.630239+0000","last_undegraded":"2023-11-19T00:40:49.630239+0000","last_fullsized":"2023-11-19T00:40:49.630239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629568+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:50.629568+0000","last_peered":"2023-11-19T00:40:50.629568+0000","last_clean":"2023-11-19T00:40:50.629568+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:50.629568+0000","last_undegraded":"2023-11-19T00:40:50.629568+0000","last_fullsized":"2023-11-19T00:40:50.629568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630478+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:49.630478+0000","last_peered":"2023-11-19T00:40:49.630478+0000","last_clean":"2023-11-19T00:40:49.630478+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:49.630478+0000","last_undegraded":"2023-11-19T00:40:49.630478+0000","last_fullsized":"2023-11-19T00:40:49.630478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628153+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:49.628153+0000","last_peered":"2023-11-19T00:40:49.628153+0000","last_clean":"2023-11-19T00:40:49.628153+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:49.628153+0000","last_undegraded":"2023-11-19T00:40:49.628153+0000","last_fullsized":"2023-11-19T00:40:49.628153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":678,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.631868+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:50.631868+0000","last_peered":"2023-11-19T00:40:50.631868+0000","last_clean":"2023-11-19T00:40:50.631868+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:50.631868+0000","last_undegraded":"2023-11-19T00:40:50.631868+0000","last_fullsized":"2023-11-19T00:40:50.631868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:52:28.650242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650608+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:49.650608+0000","last_peered":"2023-11-19T00:40:49.650608+0000","last_clean":"2023-11-19T00:40:49.650608+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:49.650608+0000","last_undegraded":"2023-11-19T00:40:49.650608+0000","last_fullsized":"2023-11-19T00:40:49.650608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:27.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828155+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:50.828155+0000","last_peered":"2023-11-19T00:40:50.828155+0000","last_clean":"2023-11-19T00:40:50.828155+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:50.828155+0000","last_undegraded":"2023-11-19T00:40:50.828155+0000","last_fullsized":"2023-11-19T00:40:50.828155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:37:55.011970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":455,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630841+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:49.630841+0000","last_peered":"2023-11-19T00:40:49.630841+0000","last_clean":"2023-11-19T00:40:49.630841+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:49.630841+0000","last_undegraded":"2023-11-19T00:40:49.630841+0000","last_fullsized":"2023-11-19T00:40:49.630841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828779+0000","last_change":"2023-11-19T00:40:49.644207+0000","last_active":"2023-11-19T00:40:50.828779+0000","last_peered":"2023-11-19T00:40:50.828779+0000","last_clean":"2023-11-19T00:40:50.828779+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:40:50.828779+0000","last_undegraded":"2023-11-19T00:40:50.828779+0000","last_fullsized":"2023-11-19T00:40:50.828779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:09.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643658+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:49.643658+0000","last_peered":"2023-11-19T00:40:49.643658+0000","last_clean":"2023-11-19T00:40:49.643658+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:49.643658+0000","last_undegraded":"2023-11-19T00:40:49.643658+0000","last_fullsized":"2023-11-19T00:40:49.643658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":241,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639279+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:49.639279+0000","last_peered":"2023-11-19T00:40:49.639279+0000","last_clean":"2023-11-19T00:40:49.639279+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:49.639279+0000","last_undegraded":"2023-11-19T00:40:49.639279+0000","last_fullsized":"2023-11-19T00:40:49.639279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:39.542692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630701+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:49.630701+0000","last_peered":"2023-11-19T00:40:49.630701+0000","last_clean":"2023-11-19T00:40:49.630701+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:49.630701+0000","last_undegraded":"2023-11-19T00:40:49.630701+0000","last_fullsized":"2023-11-19T00:40:49.630701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628872+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:49.628872+0000","last_peered":"2023-11-19T00:40:49.628872+0000","last_clean":"2023-11-19T00:40:49.628872+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:49.628872+0000","last_undegraded":"2023-11-19T00:40:49.628872+0000","last_fullsized":"2023-11-19T00:40:49.628872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.630083+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:50.630083+0000","last_peered":"2023-11-19T00:40:50.630083+0000","last_clean":"2023-11-19T00:40:50.630083+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:50.630083+0000","last_undegraded":"2023-11-19T00:40:50.630083+0000","last_fullsized":"2023-11-19T00:40:50.630083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630656+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:49.630656+0000","last_peered":"2023-11-19T00:40:49.630656+0000","last_clean":"2023-11-19T00:40:49.630656+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:49.630656+0000","last_undegraded":"2023-11-19T00:40:49.630656+0000","last_fullsized":"2023-11-19T00:40:49.630656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":223,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:49.629529+0000","last_peered":"2023-11-19T00:40:49.629529+0000","last_clean":"2023-11-19T00:40:49.629529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:49.629529+0000","last_undegraded":"2023-11-19T00:40:49.629529+0000","last_fullsized":"2023-11-19T00:40:49.629529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643295+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:49.643295+0000","last_peered":"2023-11-19T00:40:49.643295+0000","last_clean":"2023-11-19T00:40:49.643295+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:49.643295+0000","last_undegraded":"2023-11-19T00:40:49.643295+0000","last_fullsized":"2023-11-19T00:40:49.643295+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637789+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:49.637789+0000","last_peered":"2023-11-19T00:40:49.637789+0000","last_clean":"2023-11-19T00:40:49.637789+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:49.637789+0000","last_undegraded":"2023-11-19T00:40:49.637789+0000","last_fullsized":"2023-11-19T00:40:49.637789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:54.815254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":222,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627863+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:49.627863+0000","last_peered":"2023-11-19T00:40:49.627863+0000","last_clean":"2023-11-19T00:40:49.627863+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:49.627863+0000","last_undegraded":"2023-11-19T00:40:49.627863+0000","last_fullsized":"2023-11-19T00:40:49.627863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":457,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638278+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:40:49.638278+0000","last_peered":"2023-11-19T00:40:49.638278+0000","last_clean":"2023-11-19T00:40:49.638278+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:40:49.638278+0000","last_undegraded":"2023-11-19T00:40:49.638278+0000","last_fullsized":"2023-11-19T00:40:49.638278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:51.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637727+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:40:49.637727+0000","last_peered":"2023-11-19T00:40:49.637727+0000","last_clean":"2023-11-19T00:40:49.637727+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:40:49.637727+0000","last_undegraded":"2023-11-19T00:40:49.637727+0000","last_fullsized":"2023-11-19T00:40:49.637727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":627,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647647+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:40:49.647647+0000","last_peered":"2023-11-19T00:40:49.647647+0000","last_clean":"2023-11-19T00:40:49.647647+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:40:49.647647+0000","last_undegraded":"2023-11-19T00:40:49.647647+0000","last_fullsized":"2023-11-19T00:40:49.647647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:54:12.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:49.628637+0000","last_peered":"2023-11-19T00:40:49.628637+0000","last_clean":"2023-11-19T00:40:49.628637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:49.628637+0000","last_undegraded":"2023-11-19T00:40:49.628637+0000","last_fullsized":"2023-11-19T00:40:49.628637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.648800+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:40:49.648800+0000","last_peered":"2023-11-19T00:40:49.648800+0000","last_clean":"2023-11-19T00:40:49.648800+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:40:49.648800+0000","last_undegraded":"2023-11-19T00:40:49.648800+0000","last_fullsized":"2023-11-19T00:40:49.648800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:26:07.616172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":237,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630096+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:49.630096+0000","last_peered":"2023-11-19T00:40:49.630096+0000","last_clean":"2023-11-19T00:40:49.630096+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:49.630096+0000","last_undegraded":"2023-11-19T00:40:49.630096+0000","last_fullsized":"2023-11-19T00:40:49.630096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643663+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:49.643663+0000","last_peered":"2023-11-19T00:40:49.643663+0000","last_clean":"2023-11-19T00:40:49.643663+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:49.643663+0000","last_undegraded":"2023-11-19T00:40:49.643663+0000","last_fullsized":"2023-11-19T00:40:49.643663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":442,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629589+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:49.629589+0000","last_peered":"2023-11-19T00:40:49.629589+0000","last_clean":"2023-11-19T00:40:49.629589+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:49.629589+0000","last_undegraded":"2023-11-19T00:40:49.629589+0000","last_fullsized":"2023-11-19T00:40:49.629589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628701+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:49.628701+0000","last_peered":"2023-11-19T00:40:49.628701+0000","last_clean":"2023-11-19T00:40:49.628701+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:49.628701+0000","last_undegraded":"2023-11-19T00:40:49.628701+0000","last_fullsized":"2023-11-19T00:40:49.628701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630587+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:49.630587+0000","last_peered":"2023-11-19T00:40:49.630587+0000","last_clean":"2023-11-19T00:40:49.630587+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:49.630587+0000","last_undegraded":"2023-11-19T00:40:49.630587+0000","last_fullsized":"2023-11-19T00:40:49.630587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.640059+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:49.640059+0000","last_peered":"2023-11-19T00:40:49.640059+0000","last_clean":"2023-11-19T00:40:49.640059+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:49.640059+0000","last_undegraded":"2023-11-19T00:40:49.640059+0000","last_fullsized":"2023-11-19T00:40:49.640059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630153+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:49.630153+0000","last_peered":"2023-11-19T00:40:49.630153+0000","last_clean":"2023-11-19T00:40:49.630153+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:49.630153+0000","last_undegraded":"2023-11-19T00:40:49.630153+0000","last_fullsized":"2023-11-19T00:40:49.630153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":238,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627896+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:49.627896+0000","last_peered":"2023-11-19T00:40:49.627896+0000","last_clean":"2023-11-19T00:40:49.627896+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:49.627896+0000","last_undegraded":"2023-11-19T00:40:49.627896+0000","last_fullsized":"2023-11-19T00:40:49.627896+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628582+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:49.628582+0000","last_peered":"2023-11-19T00:40:49.628582+0000","last_clean":"2023-11-19T00:40:49.628582+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:49.628582+0000","last_undegraded":"2023-11-19T00:40:49.628582+0000","last_fullsized":"2023-11-19T00:40:49.628582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":687,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647554+0000","last_change":"2023-11-19T00:40:49.647066+0000","last_active":"2023-11-19T00:40:49.647554+0000","last_peered":"2023-11-19T00:40:49.647554+0000","last_clean":"2023-11-19T00:40:49.647554+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:40:49.647554+0000","last_undegraded":"2023-11-19T00:40:49.647554+0000","last_fullsized":"2023-11-19T00:40:49.647554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:51:07.279809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628388+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:49.628388+0000","last_peered":"2023-11-19T00:40:49.628388+0000","last_clean":"2023-11-19T00:40:49.628388+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:49.628388+0000","last_undegraded":"2023-11-19T00:40:49.628388+0000","last_fullsized":"2023-11-19T00:40:49.628388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":189,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649532+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:40:49.649532+0000","last_peered":"2023-11-19T00:40:49.649532+0000","last_clean":"2023-11-19T00:40:49.649532+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:40:49.649532+0000","last_undegraded":"2023-11-19T00:40:49.649532+0000","last_fullsized":"2023-11-19T00:40:49.649532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:25.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650896+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:40:49.650896+0000","last_peered":"2023-11-19T00:40:49.650896+0000","last_clean":"2023-11-19T00:40:49.650896+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:40:49.650896+0000","last_undegraded":"2023-11-19T00:40:49.650896+0000","last_fullsized":"2023-11-19T00:40:49.650896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:30.721704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":212,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650648+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:40:49.650648+0000","last_peered":"2023-11-19T00:40:49.650648+0000","last_clean":"2023-11-19T00:40:49.650648+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:40:49.650648+0000","last_undegraded":"2023-11-19T00:40:49.650648+0000","last_fullsized":"2023-11-19T00:40:49.650648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628523+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:49.628523+0000","last_peered":"2023-11-19T00:40:49.628523+0000","last_clean":"2023-11-19T00:40:49.628523+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:49.628523+0000","last_undegraded":"2023-11-19T00:40:49.628523+0000","last_fullsized":"2023-11-19T00:40:49.628523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627815+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:49.627815+0000","last_peered":"2023-11-19T00:40:49.627815+0000","last_clean":"2023-11-19T00:40:49.627815+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:49.627815+0000","last_undegraded":"2023-11-19T00:40:49.627815+0000","last_fullsized":"2023-11-19T00:40:49.627815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643201+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:49.643201+0000","last_peered":"2023-11-19T00:40:49.643201+0000","last_clean":"2023-11-19T00:40:49.643201+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:49.643201+0000","last_undegraded":"2023-11-19T00:40:49.643201+0000","last_fullsized":"2023-11-19T00:40:49.643201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":503,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646542+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:40:49.646542+0000","last_peered":"2023-11-19T00:40:49.646542+0000","last_clean":"2023-11-19T00:40:49.646542+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:40:49.646542+0000","last_undegraded":"2023-11-19T00:40:49.646542+0000","last_fullsized":"2023-11-19T00:40:49.646542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:11.509410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631204+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:49.631204+0000","last_peered":"2023-11-19T00:40:49.631204+0000","last_clean":"2023-11-19T00:40:49.631204+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:49.631204+0000","last_undegraded":"2023-11-19T00:40:49.631204+0000","last_fullsized":"2023-11-19T00:40:49.631204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82098443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99000,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272840,"statfs":{"total":96636764160,"available":96535388160,"internally_reserved":0,"allocated":46702592,"data_stored":39130954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101756,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270084,"statfs":{"total":96636764160,"available":96532566016,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.44}]}]},{"osd":1,"up_from":8,"seq":34359738400,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113292,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20076021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:40:58.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:40:58.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:40:58.358 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2023-11-19T00:40:57.048020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10821,"ondisk_log_size":10821,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314048,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801472,"statfs":{"total":289910292480,"available":289588707328,"internally_reserved":0,"allocated":157564928,"data_stored":136309863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":111061,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":-417,"num_objects_misplaced":-373,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1135,"num_bytes_recovered":11973294,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001881"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628335+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:49.628335+0000","last_peered":"2023-11-19T00:40:49.628335+0000","last_clean":"2023-11-19T00:40:49.628335+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:49.628335+0000","last_undegraded":"2023-11-19T00:40:49.628335+0000","last_fullsized":"2023-11-19T00:40:49.628335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":225,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627893+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:49.627893+0000","last_peered":"2023-11-19T00:40:49.627893+0000","last_clean":"2023-11-19T00:40:49.627893+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:49.627893+0000","last_undegraded":"2023-11-19T00:40:49.627893+0000","last_fullsized":"2023-11-19T00:40:49.627893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641372+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:49.641372+0000","last_peered":"2023-11-19T00:40:49.641372+0000","last_clean":"2023-11-19T00:40:49.641372+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:49.641372+0000","last_undegraded":"2023-11-19T00:40:49.641372+0000","last_fullsized":"2023-11-19T00:40:49.641372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:12.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650672+0000","last_change":"2023-11-19T00:40:49.649721+0000","last_active":"2023-11-19T00:40:49.650672+0000","last_peered":"2023-11-19T00:40:49.650672+0000","last_clean":"2023-11-19T00:40:49.650672+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:40:49.650672+0000","last_undegraded":"2023-11-19T00:40:49.650672+0000","last_fullsized":"2023-11-19T00:40:49.650672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:37.114888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":497,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632731+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:50.632731+0000","last_peered":"2023-11-19T00:40:50.632731+0000","last_clean":"2023-11-19T00:40:50.632731+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:50.632731+0000","last_undegraded":"2023-11-19T00:40:50.632731+0000","last_fullsized":"2023-11-19T00:40:50.632731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:47.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":452,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650631+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:40:49.650631+0000","last_peered":"2023-11-19T00:40:49.650631+0000","last_clean":"2023-11-19T00:40:49.650631+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:40:49.650631+0000","last_undegraded":"2023-11-19T00:40:49.650631+0000","last_fullsized":"2023-11-19T00:40:49.650631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:58.153284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646821+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:40:49.646821+0000","last_peered":"2023-11-19T00:40:49.646821+0000","last_clean":"2023-11-19T00:40:49.646821+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:40:49.646821+0000","last_undegraded":"2023-11-19T00:40:49.646821+0000","last_fullsized":"2023-11-19T00:40:49.646821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:27.819649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":367,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646895+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:40:49.646895+0000","last_peered":"2023-11-19T00:40:49.646895+0000","last_clean":"2023-11-19T00:40:49.646895+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:40:49.646895+0000","last_undegraded":"2023-11-19T00:40:49.646895+0000","last_fullsized":"2023-11-19T00:40:49.646895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:28:17.058785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":236,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643199+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:49.643199+0000","last_peered":"2023-11-19T00:40:49.643199+0000","last_clean":"2023-11-19T00:40:49.643199+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:49.643199+0000","last_undegraded":"2023-11-19T00:40:49.643199+0000","last_fullsized":"2023-11-19T00:40:49.643199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.644989+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:49.644989+0000","last_peered":"2023-11-19T00:40:49.644989+0000","last_clean":"2023-11-19T00:40:49.644989+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:49.644989+0000","last_undegraded":"2023-11-19T00:40:49.644989+0000","last_fullsized":"2023-11-19T00:40:49.644989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:44:32.870644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":454,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.645206+0000","last_change":"2023-11-19T00:40:49.644469+0000","last_active":"2023-11-19T00:40:49.645206+0000","last_peered":"2023-11-19T00:40:49.645206+0000","last_clean":"2023-11-19T00:40:49.645206+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:40:49.645206+0000","last_undegraded":"2023-11-19T00:40:49.645206+0000","last_fullsized":"2023-11-19T00:40:49.645206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":210,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628929+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:49.628929+0000","last_peered":"2023-11-19T00:40:49.628929+0000","last_clean":"2023-11-19T00:40:49.628929+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:49.628929+0000","last_undegraded":"2023-11-19T00:40:49.628929+0000","last_fullsized":"2023-11-19T00:40:49.628929+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":571,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628623+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:49.628623+0000","last_peered":"2023-11-19T00:40:49.628623+0000","last_clean":"2023-11-19T00:40:49.628623+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:49.628623+0000","last_undegraded":"2023-11-19T00:40:49.628623+0000","last_fullsized":"2023-11-19T00:40:49.628623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639473+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:40:49.639473+0000","last_peered":"2023-11-19T00:40:49.639473+0000","last_clean":"2023-11-19T00:40:49.639473+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:40:49.639473+0000","last_undegraded":"2023-11-19T00:40:49.639473+0000","last_fullsized":"2023-11-19T00:40:49.639473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:28.029932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.636177+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:40:49.636177+0000","last_peered":"2023-11-19T00:40:49.636177+0000","last_clean":"2023-11-19T00:40:49.636177+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:40:49.636177+0000","last_undegraded":"2023-11-19T00:40:49.636177+0000","last_fullsized":"2023-11-19T00:40:49.636177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:48:06.968931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":228,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646944+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:40:49.646944+0000","last_peered":"2023-11-19T00:40:49.646944+0000","last_clean":"2023-11-19T00:40:49.646944+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:40:49.646944+0000","last_undegraded":"2023-11-19T00:40:49.646944+0000","last_fullsized":"2023-11-19T00:40:49.646944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:51.342591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643466+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:49.643466+0000","last_peered":"2023-11-19T00:40:49.643466+0000","last_clean":"2023-11-19T00:40:49.643466+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:49.643466+0000","last_undegraded":"2023-11-19T00:40:49.643466+0000","last_fullsized":"2023-11-19T00:40:49.643466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628168+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:49.628168+0000","last_peered":"2023-11-19T00:40:49.628168+0000","last_clean":"2023-11-19T00:40:49.628168+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:49.628168+0000","last_undegraded":"2023-11-19T00:40:49.628168+0000","last_fullsized":"2023-11-19T00:40:49.628168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":416,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630248+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:49.630248+0000","last_peered":"2023-11-19T00:40:49.630248+0000","last_clean":"2023-11-19T00:40:49.630248+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:49.630248+0000","last_undegraded":"2023-11-19T00:40:49.630248+0000","last_fullsized":"2023-11-19T00:40:49.630248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":213,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650928+0000","last_change":"2023-11-19T00:40:49.650228+0000","last_active":"2023-11-19T00:40:49.650928+0000","last_peered":"2023-11-19T00:40:49.650928+0000","last_clean":"2023-11-19T00:40:49.650928+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:40:49.650928+0000","last_undegraded":"2023-11-19T00:40:49.650928+0000","last_fullsized":"2023-11-19T00:40:49.650928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649923+0000","last_change":"2023-11-19T00:40:49.648626+0000","last_active":"2023-11-19T00:40:49.649923+0000","last_peered":"2023-11-19T00:40:49.649923+0000","last_clean":"2023-11-19T00:40:49.649923+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:40:49.649923+0000","last_undegraded":"2023-11-19T00:40:49.649923+0000","last_fullsized":"2023-11-19T00:40:49.649923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627938+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:49.627938+0000","last_peered":"2023-11-19T00:40:49.627938+0000","last_clean":"2023-11-19T00:40:49.627938+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:49.627938+0000","last_undegraded":"2023-11-19T00:40:49.627938+0000","last_fullsized":"2023-11-19T00:40:49.627938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":218,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630008+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:49.630008+0000","last_peered":"2023-11-19T00:40:49.630008+0000","last_clean":"2023-11-19T00:40:49.630008+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:49.630008+0000","last_undegraded":"2023-11-19T00:40:49.630008+0000","last_fullsized":"2023-11-19T00:40:49.630008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":217,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628849+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:50.628849+0000","last_peered":"2023-11-19T00:40:50.628849+0000","last_clean":"2023-11-19T00:40:50.628849+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:50.628849+0000","last_undegraded":"2023-11-19T00:40:50.628849+0000","last_fullsized":"2023-11-19T00:40:50.628849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":248,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628440+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:49.628440+0000","last_peered":"2023-11-19T00:40:49.628440+0000","last_clean":"2023-11-19T00:40:49.628440+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:49.628440+0000","last_undegraded":"2023-11-19T00:40:49.628440+0000","last_fullsized":"2023-11-19T00:40:49.628440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":252,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643028+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:49.643028+0000","last_peered":"2023-11-19T00:40:49.643028+0000","last_clean":"2023-11-19T00:40:49.643028+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:49.643028+0000","last_undegraded":"2023-11-19T00:40:49.643028+0000","last_fullsized":"2023-11-19T00:40:49.643028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":220,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828300+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:50.828300+0000","last_peered":"2023-11-19T00:40:50.828300+0000","last_clean":"2023-11-19T00:40:50.828300+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:50.828300+0000","last_undegraded":"2023-11-19T00:40:50.828300+0000","last_fullsized":"2023-11-19T00:40:50.828300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:20.062298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628704+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:49.628704+0000","last_peered":"2023-11-19T00:40:49.628704+0000","last_clean":"2023-11-19T00:40:49.628704+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:49.628704+0000","last_undegraded":"2023-11-19T00:40:49.628704+0000","last_fullsized":"2023-11-19T00:40:49.628704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":668,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632079+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:50.632079+0000","last_peered":"2023-11-19T00:40:50.632079+0000","last_clean":"2023-11-19T00:40:50.632079+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:50.632079+0000","last_undegraded":"2023-11-19T00:40:50.632079+0000","last_fullsized":"2023-11-19T00:40:50.632079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:27:44.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628930+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:50.628930+0000","last_peered":"2023-11-19T00:40:50.628930+0000","last_clean":"2023-11-19T00:40:50.628930+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:50.628930+0000","last_undegraded":"2023-11-19T00:40:50.628930+0000","last_fullsized":"2023-11-19T00:40:50.628930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":770,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628739+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:50.628739+0000","last_peered":"2023-11-19T00:40:50.628739+0000","last_clean":"2023-11-19T00:40:50.628739+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:50.628739+0000","last_undegraded":"2023-11-19T00:40:50.628739+0000","last_fullsized":"2023-11-19T00:40:50.628739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:56:57.316040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":232,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646921+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:49.646921+0000","last_peered":"2023-11-19T00:40:49.646921+0000","last_clean":"2023-11-19T00:40:49.646921+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:49.646921+0000","last_undegraded":"2023-11-19T00:40:49.646921+0000","last_fullsized":"2023-11-19T00:40:49.646921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:41.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":403,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632086+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:50.632086+0000","last_peered":"2023-11-19T00:40:50.632086+0000","last_clean":"2023-11-19T00:40:50.632086+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:50.632086+0000","last_undegraded":"2023-11-19T00:40:50.632086+0000","last_fullsized":"2023-11-19T00:40:50.632086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:05.688454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'138","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828060+0000","last_change":"2023-11-19T00:40:49.648913+0000","last_active":"2023-11-19T00:40:50.828060+0000","last_peered":"2023-11-19T00:40:50.828060+0000","last_clean":"2023-11-19T00:40:50.828060+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:40:50.828060+0000","last_undegraded":"2023-11-19T00:40:50.828060+0000","last_fullsized":"2023-11-19T00:40:50.828060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:46.312569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.632567+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:49.632567+0000","last_peered":"2023-11-19T00:40:49.632567+0000","last_clean":"2023-11-19T00:40:49.632567+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:49.632567+0000","last_undegraded":"2023-11-19T00:40:49.632567+0000","last_fullsized":"2023-11-19T00:40:49.632567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:46.760399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643013+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:49.643013+0000","last_peered":"2023-11-19T00:40:49.643013+0000","last_clean":"2023-11-19T00:40:49.643013+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:49.643013+0000","last_undegraded":"2023-11-19T00:40:49.643013+0000","last_fullsized":"2023-11-19T00:40:49.643013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643410+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:49.643410+0000","last_peered":"2023-11-19T00:40:49.643410+0000","last_clean":"2023-11-19T00:40:49.643410+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:49.643410+0000","last_undegraded":"2023-11-19T00:40:49.643410+0000","last_fullsized":"2023-11-19T00:40:49.643410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627575+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:49.627575+0000","last_peered":"2023-11-19T00:40:49.627575+0000","last_clean":"2023-11-19T00:40:49.627575+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:49.627575+0000","last_undegraded":"2023-11-19T00:40:49.627575+0000","last_fullsized":"2023-11-19T00:40:49.627575+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631291+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:49.631291+0000","last_peered":"2023-11-19T00:40:49.631291+0000","last_clean":"2023-11-19T00:40:49.631291+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:49.631291+0000","last_undegraded":"2023-11-19T00:40:49.631291+0000","last_fullsized":"2023-11-19T00:40:49.631291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":98,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638935+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:40:49.638935+0000","last_peered":"2023-11-19T00:40:49.638935+0000","last_clean":"2023-11-19T00:40:49.638935+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:40:49.638935+0000","last_undegraded":"2023-11-19T00:40:49.638935+0000","last_fullsized":"2023-11-19T00:40:49.638935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638412+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:40:49.638412+0000","last_peered":"2023-11-19T00:40:49.638412+0000","last_clean":"2023-11-19T00:40:49.638412+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:40:49.638412+0000","last_undegraded":"2023-11-19T00:40:49.638412+0000","last_fullsized":"2023-11-19T00:40:49.638412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:07.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628327+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:49.628327+0000","last_peered":"2023-11-19T00:40:49.628327+0000","last_clean":"2023-11-19T00:40:49.628327+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:49.628327+0000","last_undegraded":"2023-11-19T00:40:49.628327+0000","last_fullsized":"2023-11-19T00:40:49.628327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627344+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:49.627344+0000","last_peered":"2023-11-19T00:40:49.627344+0000","last_clean":"2023-11-19T00:40:49.627344+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:49.627344+0000","last_undegraded":"2023-11-19T00:40:49.627344+0000","last_fullsized":"2023-11-19T00:40:49.627344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639843+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:40:49.639843+0000","last_peered":"2023-11-19T00:40:49.639843+0000","last_clean":"2023-11-19T00:40:49.639843+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:40:49.639843+0000","last_undegraded":"2023-11-19T00:40:49.639843+0000","last_fullsized":"2023-11-19T00:40:49.639843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:51.721484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":414,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827964+0000","last_change":"2023-11-19T00:40:49.645680+0000","last_active":"2023-11-19T00:40:50.827964+0000","last_peered":"2023-11-19T00:40:50.827964+0000","last_clean":"2023-11-19T00:40:50.827964+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:40:50.827964+0000","last_undegraded":"2023-11-19T00:40:50.827964+0000","last_fullsized":"2023-11-19T00:40:50.827964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:13:29.817706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650913+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:40:49.650913+0000","last_peered":"2023-11-19T00:40:49.650913+0000","last_clean":"2023-11-19T00:40:49.650913+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:40:49.650913+0000","last_undegraded":"2023-11-19T00:40:49.650913+0000","last_fullsized":"2023-11-19T00:40:49.650913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:16.205545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643393+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:49.643393+0000","last_peered":"2023-11-19T00:40:49.643393+0000","last_clean":"2023-11-19T00:40:49.643393+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:49.643393+0000","last_undegraded":"2023-11-19T00:40:49.643393+0000","last_fullsized":"2023-11-19T00:40:49.643393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643651+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:49.643651+0000","last_peered":"2023-11-19T00:40:49.643651+0000","last_clean":"2023-11-19T00:40:49.643651+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:49.643651+0000","last_undegraded":"2023-11-19T00:40:49.643651+0000","last_fullsized":"2023-11-19T00:40:49.643651+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650873+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:40:49.650873+0000","last_peered":"2023-11-19T00:40:49.650873+0000","last_clean":"2023-11-19T00:40:49.650873+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:40:49.650873+0000","last_undegraded":"2023-11-19T00:40:49.650873+0000","last_fullsized":"2023-11-19T00:40:49.650873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:19.506460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828256+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:50.828256+0000","last_peered":"2023-11-19T00:40:50.828256+0000","last_clean":"2023-11-19T00:40:50.828256+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:50.828256+0000","last_undegraded":"2023-11-19T00:40:50.828256+0000","last_fullsized":"2023-11-19T00:40:50.828256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:32.771756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641360+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:40:49.641360+0000","last_peered":"2023-11-19T00:40:49.641360+0000","last_clean":"2023-11-19T00:40:49.641360+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:40:49.641360+0000","last_undegraded":"2023-11-19T00:40:49.641360+0000","last_fullsized":"2023-11-19T00:40:49.641360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:22.553304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628860+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:50.628860+0000","last_peered":"2023-11-19T00:40:50.628860+0000","last_clean":"2023-11-19T00:40:50.628860+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:50.628860+0000","last_undegraded":"2023-11-19T00:40:50.628860+0000","last_fullsized":"2023-11-19T00:40:50.628860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":572,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638343+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:40:49.638343+0000","last_peered":"2023-11-19T00:40:49.638343+0000","last_clean":"2023-11-19T00:40:49.638343+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:40:49.638343+0000","last_undegraded":"2023-11-19T00:40:49.638343+0000","last_fullsized":"2023-11-19T00:40:49.638343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:50.437778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627558+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:49.627558+0000","last_peered":"2023-11-19T00:40:49.627558+0000","last_clean":"2023-11-19T00:40:49.627558+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:49.627558+0000","last_undegraded":"2023-11-19T00:40:49.627558+0000","last_fullsized":"2023-11-19T00:40:49.627558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":207,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643289+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:49.643289+0000","last_peered":"2023-11-19T00:40:49.643289+0000","last_clean":"2023-11-19T00:40:49.643289+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:49.643289+0000","last_undegraded":"2023-11-19T00:40:49.643289+0000","last_fullsized":"2023-11-19T00:40:49.643289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":306,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638672+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:49.638672+0000","last_peered":"2023-11-19T00:40:49.638672+0000","last_clean":"2023-11-19T00:40:49.638672+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:49.638672+0000","last_undegraded":"2023-11-19T00:40:49.638672+0000","last_fullsized":"2023-11-19T00:40:49.638672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:51.392980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650550+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:49.650550+0000","last_peered":"2023-11-19T00:40:49.650550+0000","last_clean":"2023-11-19T00:40:49.650550+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:49.650550+0000","last_undegraded":"2023-11-19T00:40:49.650550+0000","last_fullsized":"2023-11-19T00:40:49.650550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:44.483221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638914+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:49.638914+0000","last_peered":"2023-11-19T00:40:49.638914+0000","last_clean":"2023-11-19T00:40:49.638914+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:49.638914+0000","last_undegraded":"2023-11-19T00:40:49.638914+0000","last_fullsized":"2023-11-19T00:40:49.638914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:57.791481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":427,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828679+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:50.828679+0000","last_peered":"2023-11-19T00:40:50.828679+0000","last_clean":"2023-11-19T00:40:50.828679+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:50.828679+0000","last_undegraded":"2023-11-19T00:40:50.828679+0000","last_fullsized":"2023-11-19T00:40:50.828679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:02.150359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638326+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:49.638326+0000","last_peered":"2023-11-19T00:40:49.638326+0000","last_clean":"2023-11-19T00:40:49.638326+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:49.638326+0000","last_undegraded":"2023-11-19T00:40:49.638326+0000","last_fullsized":"2023-11-19T00:40:49.638326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:03:04.935661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630239+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:49.630239+0000","last_peered":"2023-11-19T00:40:49.630239+0000","last_clean":"2023-11-19T00:40:49.630239+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:49.630239+0000","last_undegraded":"2023-11-19T00:40:49.630239+0000","last_fullsized":"2023-11-19T00:40:49.630239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629568+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:50.629568+0000","last_peered":"2023-11-19T00:40:50.629568+0000","last_clean":"2023-11-19T00:40:50.629568+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:50.629568+0000","last_undegraded":"2023-11-19T00:40:50.629568+0000","last_fullsized":"2023-11-19T00:40:50.629568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630478+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:49.630478+0000","last_peered":"2023-11-19T00:40:49.630478+0000","last_clean":"2023-11-19T00:40:49.630478+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:49.630478+0000","last_undegraded":"2023-11-19T00:40:49.630478+0000","last_fullsized":"2023-11-19T00:40:49.630478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628153+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:49.628153+0000","last_peered":"2023-11-19T00:40:49.628153+0000","last_clean":"2023-11-19T00:40:49.628153+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:49.628153+0000","last_undegraded":"2023-11-19T00:40:49.628153+0000","last_fullsized":"2023-11-19T00:40:49.628153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":678,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.631868+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:50.631868+0000","last_peered":"2023-11-19T00:40:50.631868+0000","last_clean":"2023-11-19T00:40:50.631868+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:50.631868+0000","last_undegraded":"2023-11-19T00:40:50.631868+0000","last_fullsized":"2023-11-19T00:40:50.631868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:52:28.650242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650608+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:49.650608+0000","last_peered":"2023-11-19T00:40:49.650608+0000","last_clean":"2023-11-19T00:40:49.650608+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:49.650608+0000","last_undegraded":"2023-11-19T00:40:49.650608+0000","last_fullsized":"2023-11-19T00:40:49.650608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:27.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828155+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:50.828155+0000","last_peered":"2023-11-19T00:40:50.828155+0000","last_clean":"2023-11-19T00:40:50.828155+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:50.828155+0000","last_undegraded":"2023-11-19T00:40:50.828155+0000","last_fullsized":"2023-11-19T00:40:50.828155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:37:55.011970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":455,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630841+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:49.630841+0000","last_peered":"2023-11-19T00:40:49.630841+0000","last_clean":"2023-11-19T00:40:49.630841+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:49.630841+0000","last_undegraded":"2023-11-19T00:40:49.630841+0000","last_fullsized":"2023-11-19T00:40:49.630841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828779+0000","last_change":"2023-11-19T00:40:49.644207+0000","last_active":"2023-11-19T00:40:50.828779+0000","last_peered":"2023-11-19T00:40:50.828779+0000","last_clean":"2023-11-19T00:40:50.828779+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:40:50.828779+0000","last_undegraded":"2023-11-19T00:40:50.828779+0000","last_fullsized":"2023-11-19T00:40:50.828779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:09.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643658+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:49.643658+0000","last_peered":"2023-11-19T00:40:49.643658+0000","last_clean":"2023-11-19T00:40:49.643658+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:49.643658+0000","last_undegraded":"2023-11-19T00:40:49.643658+0000","last_fullsized":"2023-11-19T00:40:49.643658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":241,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639279+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:49.639279+0000","last_peered":"2023-11-19T00:40:49.639279+0000","last_clean":"2023-11-19T00:40:49.639279+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:49.639279+0000","last_undegraded":"2023-11-19T00:40:49.639279+0000","last_fullsized":"2023-11-19T00:40:49.639279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:39.542692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630701+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:49.630701+0000","last_peered":"2023-11-19T00:40:49.630701+0000","last_clean":"2023-11-19T00:40:49.630701+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:49.630701+0000","last_undegraded":"2023-11-19T00:40:49.630701+0000","last_fullsized":"2023-11-19T00:40:49.630701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628872+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:49.628872+0000","last_peered":"2023-11-19T00:40:49.628872+0000","last_clean":"2023-11-19T00:40:49.628872+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:49.628872+0000","last_undegraded":"2023-11-19T00:40:49.628872+0000","last_fullsized":"2023-11-19T00:40:49.628872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.630083+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:50.630083+0000","last_peered":"2023-11-19T00:40:50.630083+0000","last_clean":"2023-11-19T00:40:50.630083+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:50.630083+0000","last_undegraded":"2023-11-19T00:40:50.630083+0000","last_fullsized":"2023-11-19T00:40:50.630083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630656+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:49.630656+0000","last_peered":"2023-11-19T00:40:49.630656+0000","last_clean":"2023-11-19T00:40:49.630656+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:49.630656+0000","last_undegraded":"2023-11-19T00:40:49.630656+0000","last_fullsized":"2023-11-19T00:40:49.630656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":223,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:49.629529+0000","last_peered":"2023-11-19T00:40:49.629529+0000","last_clean":"2023-11-19T00:40:49.629529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:49.629529+0000","last_undegraded":"2023-11-19T00:40:49.629529+0000","last_fullsized":"2023-11-19T00:40:49.629529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643295+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:49.643295+0000","last_peered":"2023-11-19T00:40:49.643295+0000","last_clean":"2023-11-19T00:40:49.643295+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:49.643295+0000","last_undegraded":"2023-11-19T00:40:49.643295+0000","last_fullsized":"2023-11-19T00:40:49.643295+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637789+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:49.637789+0000","last_peered":"2023-11-19T00:40:49.637789+0000","last_clean":"2023-11-19T00:40:49.637789+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:49.637789+0000","last_undegraded":"2023-11-19T00:40:49.637789+0000","last_fullsized":"2023-11-19T00:40:49.637789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:54.815254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":222,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627863+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:49.627863+0000","last_peered":"2023-11-19T00:40:49.627863+0000","last_clean":"2023-11-19T00:40:49.627863+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:49.627863+0000","last_undegraded":"2023-11-19T00:40:49.627863+0000","last_fullsized":"2023-11-19T00:40:49.627863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":457,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638278+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:40:49.638278+0000","last_peered":"2023-11-19T00:40:49.638278+0000","last_clean":"2023-11-19T00:40:49.638278+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:40:49.638278+0000","last_undegraded":"2023-11-19T00:40:49.638278+0000","last_fullsized":"2023-11-19T00:40:49.638278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:51.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637727+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:40:49.637727+0000","last_peered":"2023-11-19T00:40:49.637727+0000","last_clean":"2023-11-19T00:40:49.637727+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:40:49.637727+0000","last_undegraded":"2023-11-19T00:40:49.637727+0000","last_fullsized":"2023-11-19T00:40:49.637727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":627,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647647+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:40:49.647647+0000","last_peered":"2023-11-19T00:40:49.647647+0000","last_clean":"2023-11-19T00:40:49.647647+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:40:49.647647+0000","last_undegraded":"2023-11-19T00:40:49.647647+0000","last_fullsized":"2023-11-19T00:40:49.647647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:54:12.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:49.628637+0000","last_peered":"2023-11-19T00:40:49.628637+0000","last_clean":"2023-11-19T00:40:49.628637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:49.628637+0000","last_undegraded":"2023-11-19T00:40:49.628637+0000","last_fullsized":"2023-11-19T00:40:49.628637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.648800+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:40:49.648800+0000","last_peered":"2023-11-19T00:40:49.648800+0000","last_clean":"2023-11-19T00:40:49.648800+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:40:49.648800+0000","last_undegraded":"2023-11-19T00:40:49.648800+0000","last_fullsized":"2023-11-19T00:40:49.648800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:26:07.616172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":237,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630096+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:49.630096+0000","last_peered":"2023-11-19T00:40:49.630096+0000","last_clean":"2023-11-19T00:40:49.630096+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:49.630096+0000","last_undegraded":"2023-11-19T00:40:49.630096+0000","last_fullsized":"2023-11-19T00:40:49.630096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643663+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:49.643663+0000","last_peered":"2023-11-19T00:40:49.643663+0000","last_clean":"2023-11-19T00:40:49.643663+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:49.643663+0000","last_undegraded":"2023-11-19T00:40:49.643663+0000","last_fullsized":"2023-11-19T00:40:49.643663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":442,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629589+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:49.629589+0000","last_peered":"2023-11-19T00:40:49.629589+0000","last_clean":"2023-11-19T00:40:49.629589+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:49.629589+0000","last_undegraded":"2023-11-19T00:40:49.629589+0000","last_fullsized":"2023-11-19T00:40:49.629589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628701+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:49.628701+0000","last_peered":"2023-11-19T00:40:49.628701+0000","last_clean":"2023-11-19T00:40:49.628701+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:49.628701+0000","last_undegraded":"2023-11-19T00:40:49.628701+0000","last_fullsized":"2023-11-19T00:40:49.628701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630587+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:49.630587+0000","last_peered":"2023-11-19T00:40:49.630587+0000","last_clean":"2023-11-19T00:40:49.630587+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:49.630587+0000","last_undegraded":"2023-11-19T00:40:49.630587+0000","last_fullsized":"2023-11-19T00:40:49.630587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.640059+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:49.640059+0000","last_peered":"2023-11-19T00:40:49.640059+0000","last_clean":"2023-11-19T00:40:49.640059+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:49.640059+0000","last_undegraded":"2023-11-19T00:40:49.640059+0000","last_fullsized":"2023-11-19T00:40:49.640059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630153+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:49.630153+0000","last_peered":"2023-11-19T00:40:49.630153+0000","last_clean":"2023-11-19T00:40:49.630153+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:49.630153+0000","last_undegraded":"2023-11-19T00:40:49.630153+0000","last_fullsized":"2023-11-19T00:40:49.630153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":238,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627896+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:49.627896+0000","last_peered":"2023-11-19T00:40:49.627896+0000","last_clean":"2023-11-19T00:40:49.627896+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:49.627896+0000","last_undegraded":"2023-11-19T00:40:49.627896+0000","last_fullsized":"2023-11-19T00:40:49.627896+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628582+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:49.628582+0000","last_peered":"2023-11-19T00:40:49.628582+0000","last_clean":"2023-11-19T00:40:49.628582+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:49.628582+0000","last_undegraded":"2023-11-19T00:40:49.628582+0000","last_fullsized":"2023-11-19T00:40:49.628582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":687,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647554+0000","last_change":"2023-11-19T00:40:49.647066+0000","last_active":"2023-11-19T00:40:49.647554+0000","last_peered":"2023-11-19T00:40:49.647554+0000","last_clean":"2023-11-19T00:40:49.647554+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:40:49.647554+0000","last_undegraded":"2023-11-19T00:40:49.647554+0000","last_fullsized":"2023-11-19T00:40:49.647554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:51:07.279809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628388+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:49.628388+0000","last_peered":"2023-11-19T00:40:49.628388+0000","last_clean":"2023-11-19T00:40:49.628388+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:49.628388+0000","last_undegraded":"2023-11-19T00:40:49.628388+0000","last_fullsized":"2023-11-19T00:40:49.628388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":189,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649532+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:40:49.649532+0000","last_peered":"2023-11-19T00:40:49.649532+0000","last_clean":"2023-11-19T00:40:49.649532+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:40:49.649532+0000","last_undegraded":"2023-11-19T00:40:49.649532+0000","last_fullsized":"2023-11-19T00:40:49.649532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:25.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650896+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:40:49.650896+0000","last_peered":"2023-11-19T00:40:49.650896+0000","last_clean":"2023-11-19T00:40:49.650896+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:40:49.650896+0000","last_undegraded":"2023-11-19T00:40:49.650896+0000","last_fullsized":"2023-11-19T00:40:49.650896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:30.721704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":212,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650648+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:40:49.650648+0000","last_peered":"2023-11-19T00:40:49.650648+0000","last_clean":"2023-11-19T00:40:49.650648+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:40:49.650648+0000","last_undegraded":"2023-11-19T00:40:49.650648+0000","last_fullsized":"2023-11-19T00:40:49.650648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628523+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:49.628523+0000","last_peered":"2023-11-19T00:40:49.628523+0000","last_clean":"2023-11-19T00:40:49.628523+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:49.628523+0000","last_undegraded":"2023-11-19T00:40:49.628523+0000","last_fullsized":"2023-11-19T00:40:49.628523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627815+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:49.627815+0000","last_peered":"2023-11-19T00:40:49.627815+0000","last_clean":"2023-11-19T00:40:49.627815+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:49.627815+0000","last_undegraded":"2023-11-19T00:40:49.627815+0000","last_fullsized":"2023-11-19T00:40:49.627815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643201+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:49.643201+0000","last_peered":"2023-11-19T00:40:49.643201+0000","last_clean":"2023-11-19T00:40:49.643201+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:49.643201+0000","last_undegraded":"2023-11-19T00:40:49.643201+0000","last_fullsized":"2023-11-19T00:40:49.643201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":503,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646542+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:40:49.646542+0000","last_peered":"2023-11-19T00:40:49.646542+0000","last_clean":"2023-11-19T00:40:49.646542+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:40:49.646542+0000","last_undegraded":"2023-11-19T00:40:49.646542+0000","last_fullsized":"2023-11-19T00:40:49.646542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:11.509410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631204+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:49.631204+0000","last_peered":"2023-11-19T00:40:49.631204+0000","last_clean":"2023-11-19T00:40:49.631204+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:49.631204+0000","last_undegraded":"2023-11-19T00:40:49.631204+0000","last_fullsized":"2023-11-19T00:40:49.631204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82098443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99000,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272840,"statfs":{"total":96636764160,"available":96535388160,"internally_reserved":0,"allocated":46702592,"data_stored":39130954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101756,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270084,"statfs":{"total":96636764160,"available":96532566016,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.44}]}]},{"osd":1,"up_from":8,"seq":34359738400,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113292,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20076021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:40:58.362 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-19T00:40:58.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:40:58.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:58.702 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:40:58.712 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2023-11-19T00:40:57.048020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10821,"ondisk_log_size":10821,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314048,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801472,"statfs":{"total":289910292480,"available":289588707328,"internally_reserved":0,"allocated":157564928,"data_stored":136309863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":111061,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":-417,"num_objects_misplaced":-373,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1135,"num_bytes_recovered":11973294,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001881"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628335+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:49.628335+0000","last_peered":"2023-11-19T00:40:49.628335+0000","last_clean":"2023-11-19T00:40:49.628335+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:49.628335+0000","last_undegraded":"2023-11-19T00:40:49.628335+0000","last_fullsized":"2023-11-19T00:40:49.628335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":225,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627893+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:49.627893+0000","last_peered":"2023-11-19T00:40:49.627893+0000","last_clean":"2023-11-19T00:40:49.627893+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:49.627893+0000","last_undegraded":"2023-11-19T00:40:49.627893+0000","last_fullsized":"2023-11-19T00:40:49.627893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641372+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:49.641372+0000","last_peered":"2023-11-19T00:40:49.641372+0000","last_clean":"2023-11-19T00:40:49.641372+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:49.641372+0000","last_undegraded":"2023-11-19T00:40:49.641372+0000","last_fullsized":"2023-11-19T00:40:49.641372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:12.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650672+0000","last_change":"2023-11-19T00:40:49.649721+0000","last_active":"2023-11-19T00:40:49.650672+0000","last_peered":"2023-11-19T00:40:49.650672+0000","last_clean":"2023-11-19T00:40:49.650672+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:40:49.650672+0000","last_undegraded":"2023-11-19T00:40:49.650672+0000","last_fullsized":"2023-11-19T00:40:49.650672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:37.114888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":497,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632731+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:50.632731+0000","last_peered":"2023-11-19T00:40:50.632731+0000","last_clean":"2023-11-19T00:40:50.632731+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:50.632731+0000","last_undegraded":"2023-11-19T00:40:50.632731+0000","last_fullsized":"2023-11-19T00:40:50.632731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:47.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":452,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650631+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:40:49.650631+0000","last_peered":"2023-11-19T00:40:49.650631+0000","last_clean":"2023-11-19T00:40:49.650631+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:40:49.650631+0000","last_undegraded":"2023-11-19T00:40:49.650631+0000","last_fullsized":"2023-11-19T00:40:49.650631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:58.153284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646821+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:40:49.646821+0000","last_peered":"2023-11-19T00:40:49.646821+0000","last_clean":"2023-11-19T00:40:49.646821+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:40:49.646821+0000","last_undegraded":"2023-11-19T00:40:49.646821+0000","last_fullsized":"2023-11-19T00:40:49.646821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:27.819649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":367,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646895+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:40:49.646895+0000","last_peered":"2023-11-19T00:40:49.646895+0000","last_clean":"2023-11-19T00:40:49.646895+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:40:49.646895+0000","last_undegraded":"2023-11-19T00:40:49.646895+0000","last_fullsized":"2023-11-19T00:40:49.646895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:28:17.058785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":236,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643199+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:49.643199+0000","last_peered":"2023-11-19T00:40:49.643199+0000","last_clean":"2023-11-19T00:40:49.643199+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:49.643199+0000","last_undegraded":"2023-11-19T00:40:49.643199+0000","last_fullsized":"2023-11-19T00:40:49.643199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.644989+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:49.644989+0000","last_peered":"2023-11-19T00:40:49.644989+0000","last_clean":"2023-11-19T00:40:49.644989+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:49.644989+0000","last_undegraded":"2023-11-19T00:40:49.644989+0000","last_fullsized":"2023-11-19T00:40:49.644989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:44:32.870644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":454,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.645206+0000","last_change":"2023-11-19T00:40:49.644469+0000","last_active":"2023-11-19T00:40:49.645206+0000","last_peered":"2023-11-19T00:40:49.645206+0000","last_clean":"2023-11-19T00:40:49.645206+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:40:49.645206+0000","last_undegraded":"2023-11-19T00:40:49.645206+0000","last_fullsized":"2023-11-19T00:40:49.645206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":210,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628929+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:49.628929+0000","last_peered":"2023-11-19T00:40:49.628929+0000","last_clean":"2023-11-19T00:40:49.628929+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:49.628929+0000","last_undegraded":"2023-11-19T00:40:49.628929+0000","last_fullsized":"2023-11-19T00:40:49.628929+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":571,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628623+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:49.628623+0000","last_peered":"2023-11-19T00:40:49.628623+0000","last_clean":"2023-11-19T00:40:49.628623+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:49.628623+0000","last_undegraded":"2023-11-19T00:40:49.628623+0000","last_fullsized":"2023-11-19T00:40:49.628623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639473+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:40:49.639473+0000","last_peered":"2023-11-19T00:40:49.639473+0000","last_clean":"2023-11-19T00:40:49.639473+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:40:49.639473+0000","last_undegraded":"2023-11-19T00:40:49.639473+0000","last_fullsized":"2023-11-19T00:40:49.639473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:28.029932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.636177+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:40:49.636177+0000","last_peered":"2023-11-19T00:40:49.636177+0000","last_clean":"2023-11-19T00:40:49.636177+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:40:49.636177+0000","last_undegraded":"2023-11-19T00:40:49.636177+0000","last_fullsized":"2023-11-19T00:40:49.636177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:48:06.968931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":228,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646944+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:40:49.646944+0000","last_peered":"2023-11-19T00:40:49.646944+0000","last_clean":"2023-11-19T00:40:49.646944+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:40:49.646944+0000","last_undegraded":"2023-11-19T00:40:49.646944+0000","last_fullsized":"2023-11-19T00:40:49.646944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:51.342591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643466+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:49.643466+0000","last_peered":"2023-11-19T00:40:49.643466+0000","last_clean":"2023-11-19T00:40:49.643466+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:49.643466+0000","last_undegraded":"2023-11-19T00:40:49.643466+0000","last_fullsized":"2023-11-19T00:40:49.643466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628168+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:49.628168+0000","last_peered":"2023-11-19T00:40:49.628168+0000","last_clean":"2023-11-19T00:40:49.628168+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:49.628168+0000","last_undegraded":"2023-11-19T00:40:49.628168+0000","last_fullsized":"2023-11-19T00:40:49.628168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":416,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630248+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:49.630248+0000","last_peered":"2023-11-19T00:40:49.630248+0000","last_clean":"2023-11-19T00:40:49.630248+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:49.630248+0000","last_undegraded":"2023-11-19T00:40:49.630248+0000","last_fullsized":"2023-11-19T00:40:49.630248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":213,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650928+0000","last_change":"2023-11-19T00:40:49.650228+0000","last_active":"2023-11-19T00:40:49.650928+0000","last_peered":"2023-11-19T00:40:49.650928+0000","last_clean":"2023-11-19T00:40:49.650928+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:40:49.650928+0000","last_undegraded":"2023-11-19T00:40:49.650928+0000","last_fullsized":"2023-11-19T00:40:49.650928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649923+0000","last_change":"2023-11-19T00:40:49.648626+0000","last_active":"2023-11-19T00:40:49.649923+0000","last_peered":"2023-11-19T00:40:49.649923+0000","last_clean":"2023-11-19T00:40:49.649923+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:40:49.649923+0000","last_undegraded":"2023-11-19T00:40:49.649923+0000","last_fullsized":"2023-11-19T00:40:49.649923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627938+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:49.627938+0000","last_peered":"2023-11-19T00:40:49.627938+0000","last_clean":"2023-11-19T00:40:49.627938+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:49.627938+0000","last_undegraded":"2023-11-19T00:40:49.627938+0000","last_fullsized":"2023-11-19T00:40:49.627938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":218,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630008+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:49.630008+0000","last_peered":"2023-11-19T00:40:49.630008+0000","last_clean":"2023-11-19T00:40:49.630008+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:49.630008+0000","last_undegraded":"2023-11-19T00:40:49.630008+0000","last_fullsized":"2023-11-19T00:40:49.630008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":217,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628849+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:50.628849+0000","last_peered":"2023-11-19T00:40:50.628849+0000","last_clean":"2023-11-19T00:40:50.628849+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:50.628849+0000","last_undegraded":"2023-11-19T00:40:50.628849+0000","last_fullsized":"2023-11-19T00:40:50.628849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":248,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628440+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:49.628440+0000","last_peered":"2023-11-19T00:40:49.628440+0000","last_clean":"2023-11-19T00:40:49.628440+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:49.628440+0000","last_undegraded":"2023-11-19T00:40:49.628440+0000","last_fullsized":"2023-11-19T00:40:49.628440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":252,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643028+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:49.643028+0000","last_peered":"2023-11-19T00:40:49.643028+0000","last_clean":"2023-11-19T00:40:49.643028+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:49.643028+0000","last_undegraded":"2023-11-19T00:40:49.643028+0000","last_fullsized":"2023-11-19T00:40:49.643028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":220,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828300+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:50.828300+0000","last_peered":"2023-11-19T00:40:50.828300+0000","last_clean":"2023-11-19T00:40:50.828300+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:50.828300+0000","last_undegraded":"2023-11-19T00:40:50.828300+0000","last_fullsized":"2023-11-19T00:40:50.828300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:20.062298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628704+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:49.628704+0000","last_peered":"2023-11-19T00:40:49.628704+0000","last_clean":"2023-11-19T00:40:49.628704+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:49.628704+0000","last_undegraded":"2023-11-19T00:40:49.628704+0000","last_fullsized":"2023-11-19T00:40:49.628704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":668,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632079+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:50.632079+0000","last_peered":"2023-11-19T00:40:50.632079+0000","last_clean":"2023-11-19T00:40:50.632079+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:50.632079+0000","last_undegraded":"2023-11-19T00:40:50.632079+0000","last_fullsized":"2023-11-19T00:40:50.632079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:27:44.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628930+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:50.628930+0000","last_peered":"2023-11-19T00:40:50.628930+0000","last_clean":"2023-11-19T00:40:50.628930+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:50.628930+0000","last_undegraded":"2023-11-19T00:40:50.628930+0000","last_fullsized":"2023-11-19T00:40:50.628930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":770,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628739+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:50.628739+0000","last_peered":"2023-11-19T00:40:50.628739+0000","last_clean":"2023-11-19T00:40:50.628739+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:50.628739+0000","last_undegraded":"2023-11-19T00:40:50.628739+0000","last_fullsized":"2023-11-19T00:40:50.628739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:56:57.316040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":232,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646921+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:49.646921+0000","last_peered":"2023-11-19T00:40:49.646921+0000","last_clean":"2023-11-19T00:40:49.646921+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:49.646921+0000","last_undegraded":"2023-11-19T00:40:49.646921+0000","last_fullsized":"2023-11-19T00:40:49.646921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:41.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":403,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632086+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:50.632086+0000","last_peered":"2023-11-19T00:40:50.632086+0000","last_clean":"2023-11-19T00:40:50.632086+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:50.632086+0000","last_undegraded":"2023-11-19T00:40:50.632086+0000","last_fullsized":"2023-11-19T00:40:50.632086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:05.688454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'138","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828060+0000","last_change":"2023-11-19T00:40:49.648913+0000","last_active":"2023-11-19T00:40:50.828060+0000","last_peered":"2023-11-19T00:40:50.828060+0000","last_clean":"2023-11-19T00:40:50.828060+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:40:50.828060+0000","last_undegraded":"2023-11-19T00:40:50.828060+0000","last_fullsized":"2023-11-19T00:40:50.828060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:46.312569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.632567+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:49.632567+0000","last_peered":"2023-11-19T00:40:49.632567+0000","last_clean":"2023-11-19T00:40:49.632567+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:49.632567+0000","last_undegraded":"2023-11-19T00:40:49.632567+0000","last_fullsized":"2023-11-19T00:40:49.632567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:46.760399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643013+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:49.643013+0000","last_peered":"2023-11-19T00:40:49.643013+0000","last_clean":"2023-11-19T00:40:49.643013+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:49.643013+0000","last_undegraded":"2023-11-19T00:40:49.643013+0000","last_fullsized":"2023-11-19T00:40:49.643013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643410+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:49.643410+0000","last_peered":"2023-11-19T00:40:49.643410+0000","last_clean":"2023-11-19T00:40:49.643410+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:49.643410+0000","last_undegraded":"2023-11-19T00:40:49.643410+0000","last_fullsized":"2023-11-19T00:40:49.643410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627575+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:49.627575+0000","last_peered":"2023-11-19T00:40:49.627575+0000","last_clean":"2023-11-19T00:40:49.627575+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:49.627575+0000","last_undegraded":"2023-11-19T00:40:49.627575+0000","last_fullsized":"2023-11-19T00:40:49.627575+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631291+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:49.631291+0000","last_peered":"2023-11-19T00:40:49.631291+0000","last_clean":"2023-11-19T00:40:49.631291+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:49.631291+0000","last_undegraded":"2023-11-19T00:40:49.631291+0000","last_fullsized":"2023-11-19T00:40:49.631291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":98,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638935+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:40:49.638935+0000","last_peered":"2023-11-19T00:40:49.638935+0000","last_clean":"2023-11-19T00:40:49.638935+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:40:49.638935+0000","last_undegraded":"2023-11-19T00:40:49.638935+0000","last_fullsized":"2023-11-19T00:40:49.638935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638412+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:40:49.638412+0000","last_peered":"2023-11-19T00:40:49.638412+0000","last_clean":"2023-11-19T00:40:49.638412+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:40:49.638412+0000","last_undegraded":"2023-11-19T00:40:49.638412+0000","last_fullsized":"2023-11-19T00:40:49.638412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:07.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628327+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:49.628327+0000","last_peered":"2023-11-19T00:40:49.628327+0000","last_clean":"2023-11-19T00:40:49.628327+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:49.628327+0000","last_undegraded":"2023-11-19T00:40:49.628327+0000","last_fullsized":"2023-11-19T00:40:49.628327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627344+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:49.627344+0000","last_peered":"2023-11-19T00:40:49.627344+0000","last_clean":"2023-11-19T00:40:49.627344+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:49.627344+0000","last_undegraded":"2023-11-19T00:40:49.627344+0000","last_fullsized":"2023-11-19T00:40:49.627344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639843+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:40:49.639843+0000","last_peered":"2023-11-19T00:40:49.639843+0000","last_clean":"2023-11-19T00:40:49.639843+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:40:49.639843+0000","last_undegraded":"2023-11-19T00:40:49.639843+0000","last_fullsized":"2023-11-19T00:40:49.639843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:51.721484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":414,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827964+0000","last_change":"2023-11-19T00:40:49.645680+0000","last_active":"2023-11-19T00:40:50.827964+0000","last_peered":"2023-11-19T00:40:50.827964+0000","last_clean":"2023-11-19T00:40:50.827964+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:40:50.827964+0000","last_undegraded":"2023-11-19T00:40:50.827964+0000","last_fullsized":"2023-11-19T00:40:50.827964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:13:29.817706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650913+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:40:49.650913+0000","last_peered":"2023-11-19T00:40:49.650913+0000","last_clean":"2023-11-19T00:40:49.650913+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:40:49.650913+0000","last_undegraded":"2023-11-19T00:40:49.650913+0000","last_fullsized":"2023-11-19T00:40:49.650913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:16.205545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643393+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:49.643393+0000","last_peered":"2023-11-19T00:40:49.643393+0000","last_clean":"2023-11-19T00:40:49.643393+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:49.643393+0000","last_undegraded":"2023-11-19T00:40:49.643393+0000","last_fullsized":"2023-11-19T00:40:49.643393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643651+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:49.643651+0000","last_peered":"2023-11-19T00:40:49.643651+0000","last_clean":"2023-11-19T00:40:49.643651+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:49.643651+0000","last_undegraded":"2023-11-19T00:40:49.643651+0000","last_fullsized":"2023-11-19T00:40:49.643651+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650873+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:40:49.650873+0000","last_peered":"2023-11-19T00:40:49.650873+0000","last_clean":"2023-11-19T00:40:49.650873+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:40:49.650873+0000","last_undegraded":"2023-11-19T00:40:49.650873+0000","last_fullsized":"2023-11-19T00:40:49.650873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:19.506460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828256+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:50.828256+0000","last_peered":"2023-11-19T00:40:50.828256+0000","last_clean":"2023-11-19T00:40:50.828256+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:50.828256+0000","last_undegraded":"2023-11-19T00:40:50.828256+0000","last_fullsized":"2023-11-19T00:40:50.828256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:32.771756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641360+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:40:49.641360+0000","last_peered":"2023-11-19T00:40:49.641360+0000","last_clean":"2023-11-19T00:40:49.641360+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:40:49.641360+0000","last_undegraded":"2023-11-19T00:40:49.641360+0000","last_fullsized":"2023-11-19T00:40:49.641360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:22.553304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628860+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:50.628860+0000","last_peered":"2023-11-19T00:40:50.628860+0000","last_clean":"2023-11-19T00:40:50.628860+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:50.628860+0000","last_undegraded":"2023-11-19T00:40:50.628860+0000","last_fullsized":"2023-11-19T00:40:50.628860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":572,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638343+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:40:49.638343+0000","last_peered":"2023-11-19T00:40:49.638343+0000","last_clean":"2023-11-19T00:40:49.638343+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:40:49.638343+0000","last_undegraded":"2023-11-19T00:40:49.638343+0000","last_fullsized":"2023-11-19T00:40:49.638343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:50.437778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627558+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:49.627558+0000","last_peered":"2023-11-19T00:40:49.627558+0000","last_clean":"2023-11-19T00:40:49.627558+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:49.627558+0000","last_undegraded":"2023-11-19T00:40:49.627558+0000","last_fullsized":"2023-11-19T00:40:49.627558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":207,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643289+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:49.643289+0000","last_peered":"2023-11-19T00:40:49.643289+0000","last_clean":"2023-11-19T00:40:49.643289+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:49.643289+0000","last_undegraded":"2023-11-19T00:40:49.643289+0000","last_fullsized":"2023-11-19T00:40:49.643289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":306,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638672+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:49.638672+0000","last_peered":"2023-11-19T00:40:49.638672+0000","last_clean":"2023-11-19T00:40:49.638672+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:49.638672+0000","last_undegraded":"2023-11-19T00:40:49.638672+0000","last_fullsized":"2023-11-19T00:40:49.638672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:51.392980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650550+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:49.650550+0000","last_peered":"2023-11-19T00:40:49.650550+0000","last_clean":"2023-11-19T00:40:49.650550+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:49.650550+0000","last_undegraded":"2023-11-19T00:40:49.650550+0000","last_fullsized":"2023-11-19T00:40:49.650550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:44.483221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638914+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:49.638914+0000","last_peered":"2023-11-19T00:40:49.638914+0000","last_clean":"2023-11-19T00:40:49.638914+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:49.638914+0000","last_undegraded":"2023-11-19T00:40:49.638914+0000","last_fullsized":"2023-11-19T00:40:49.638914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:57.791481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":427,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828679+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:50.828679+0000","last_peered":"2023-11-19T00:40:50.828679+0000","last_clean":"2023-11-19T00:40:50.828679+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:50.828679+0000","last_undegraded":"2023-11-19T00:40:50.828679+0000","last_fullsized":"2023-11-19T00:40:50.828679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:02.150359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638326+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:49.638326+0000","last_peered":"2023-11-19T00:40:49.638326+0000","last_clean":"2023-11-19T00:40:49.638326+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:49.638326+0000","last_undegraded":"2023-11-19T00:40:49.638326+0000","last_fullsized":"2023-11-19T00:40:49.638326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:03:04.935661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630239+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:49.630239+0000","last_peered":"2023-11-19T00:40:49.630239+0000","last_clean":"2023-11-19T00:40:49.630239+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:49.630239+0000","last_undegraded":"2023-11-19T00:40:49.630239+0000","last_fullsized":"2023-11-19T00:40:49.630239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629568+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:50.629568+0000","last_peered":"2023-11-19T00:40:50.629568+0000","last_clean":"2023-11-19T00:40:50.629568+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:50.629568+0000","last_undegraded":"2023-11-19T00:40:50.629568+0000","last_fullsized":"2023-11-19T00:40:50.629568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630478+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:49.630478+0000","last_peered":"2023-11-19T00:40:49.630478+0000","last_clean":"2023-11-19T00:40:49.630478+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:49.630478+0000","last_undegraded":"2023-11-19T00:40:49.630478+0000","last_fullsized":"2023-11-19T00:40:49.630478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628153+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:49.628153+0000","last_peered":"2023-11-19T00:40:49.628153+0000","last_clean":"2023-11-19T00:40:49.628153+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:49.628153+0000","last_undegraded":"2023-11-19T00:40:49.628153+0000","last_fullsized":"2023-11-19T00:40:49.628153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":678,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.631868+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:50.631868+0000","last_peered":"2023-11-19T00:40:50.631868+0000","last_clean":"2023-11-19T00:40:50.631868+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:50.631868+0000","last_undegraded":"2023-11-19T00:40:50.631868+0000","last_fullsized":"2023-11-19T00:40:50.631868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:52:28.650242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650608+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:49.650608+0000","last_peered":"2023-11-19T00:40:49.650608+0000","last_clean":"2023-11-19T00:40:49.650608+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:49.650608+0000","last_undegraded":"2023-11-19T00:40:49.650608+0000","last_fullsized":"2023-11-19T00:40:49.650608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:27.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828155+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:50.828155+0000","last_peered":"2023-11-19T00:40:50.828155+0000","last_clean":"2023-11-19T00:40:50.828155+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:50.828155+0000","last_undegraded":"2023-11-19T00:40:50.828155+0000","last_fullsized":"2023-11-19T00:40:50.828155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:37:55.011970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":455,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630841+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:49.630841+0000","last_peered":"2023-11-19T00:40:49.630841+0000","last_clean":"2023-11-19T00:40:49.630841+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:49.630841+0000","last_undegraded":"2023-11-19T00:40:49.630841+0000","last_fullsized":"2023-11-19T00:40:49.630841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828779+0000","last_change":"2023-11-19T00:40:49.644207+0000","last_active":"2023-11-19T00:40:50.828779+0000","last_peered":"2023-11-19T00:40:50.828779+0000","last_clean":"2023-11-19T00:40:50.828779+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:40:50.828779+0000","last_undegraded":"2023-11-19T00:40:50.828779+0000","last_fullsized":"2023-11-19T00:40:50.828779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:09.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643658+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:49.643658+0000","last_peered":"2023-11-19T00:40:49.643658+0000","last_clean":"2023-11-19T00:40:49.643658+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:49.643658+0000","last_undegraded":"2023-11-19T00:40:49.643658+0000","last_fullsized":"2023-11-19T00:40:49.643658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":241,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639279+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:49.639279+0000","last_peered":"2023-11-19T00:40:49.639279+0000","last_clean":"2023-11-19T00:40:49.639279+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:49.639279+0000","last_undegraded":"2023-11-19T00:40:49.639279+0000","last_fullsized":"2023-11-19T00:40:49.639279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:39.542692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630701+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:49.630701+0000","last_peered":"2023-11-19T00:40:49.630701+0000","last_clean":"2023-11-19T00:40:49.630701+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:49.630701+0000","last_undegraded":"2023-11-19T00:40:49.630701+0000","last_fullsized":"2023-11-19T00:40:49.630701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628872+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:49.628872+0000","last_peered":"2023-11-19T00:40:49.628872+0000","last_clean":"2023-11-19T00:40:49.628872+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:49.628872+0000","last_undegraded":"2023-11-19T00:40:49.628872+0000","last_fullsized":"2023-11-19T00:40:49.628872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.630083+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:50.630083+0000","last_peered":"2023-11-19T00:40:50.630083+0000","last_clean":"2023-11-19T00:40:50.630083+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:50.630083+0000","last_undegraded":"2023-11-19T00:40:50.630083+0000","last_fullsized":"2023-11-19T00:40:50.630083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630656+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:49.630656+0000","last_peered":"2023-11-19T00:40:49.630656+0000","last_clean":"2023-11-19T00:40:49.630656+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:49.630656+0000","last_undegraded":"2023-11-19T00:40:49.630656+0000","last_fullsized":"2023-11-19T00:40:49.630656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":223,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:49.629529+0000","last_peered":"2023-11-19T00:40:49.629529+0000","last_clean":"2023-11-19T00:40:49.629529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:49.629529+0000","last_undegraded":"2023-11-19T00:40:49.629529+0000","last_fullsized":"2023-11-19T00:40:49.629529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643295+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:49.643295+0000","last_peered":"2023-11-19T00:40:49.643295+0000","last_clean":"2023-11-19T00:40:49.643295+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:49.643295+0000","last_undegraded":"2023-11-19T00:40:49.643295+0000","last_fullsized":"2023-11-19T00:40:49.643295+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637789+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:49.637789+0000","last_peered":"2023-11-19T00:40:49.637789+0000","last_clean":"2023-11-19T00:40:49.637789+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:49.637789+0000","last_undegraded":"2023-11-19T00:40:49.637789+0000","last_fullsized":"2023-11-19T00:40:49.637789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:54.815254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":222,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627863+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:49.627863+0000","last_peered":"2023-11-19T00:40:49.627863+0000","last_clean":"2023-11-19T00:40:49.627863+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:49.627863+0000","last_undegraded":"2023-11-19T00:40:49.627863+0000","last_fullsized":"2023-11-19T00:40:49.627863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":457,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638278+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:40:49.638278+0000","last_peered":"2023-11-19T00:40:49.638278+0000","last_clean":"2023-11-19T00:40:49.638278+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:40:49.638278+0000","last_undegraded":"2023-11-19T00:40:49.638278+0000","last_fullsized":"2023-11-19T00:40:49.638278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:51.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637727+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:40:49.637727+0000","last_peered":"2023-11-19T00:40:49.637727+0000","last_clean":"2023-11-19T00:40:49.637727+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:40:49.637727+0000","last_undegraded":"2023-11-19T00:40:49.637727+0000","last_fullsized":"2023-11-19T00:40:49.637727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":627,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647647+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:40:49.647647+0000","last_peered":"2023-11-19T00:40:49.647647+0000","last_clean":"2023-11-19T00:40:49.647647+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:40:49.647647+0000","last_undegraded":"2023-11-19T00:40:49.647647+0000","last_fullsized":"2023-11-19T00:40:49.647647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:54:12.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:49.628637+0000","last_peered":"2023-11-19T00:40:49.628637+0000","last_clean":"2023-11-19T00:40:49.628637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:49.628637+0000","last_undegraded":"2023-11-19T00:40:49.628637+0000","last_fullsized":"2023-11-19T00:40:49.628637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.648800+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:40:49.648800+0000","last_peered":"2023-11-19T00:40:49.648800+0000","last_clean":"2023-11-19T00:40:49.648800+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:40:49.648800+0000","last_undegraded":"2023-11-19T00:40:49.648800+0000","last_fullsized":"2023-11-19T00:40:49.648800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:26:07.616172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":237,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630096+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:49.630096+0000","last_peered":"2023-11-19T00:40:49.630096+0000","last_clean":"2023-11-19T00:40:49.630096+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:49.630096+0000","last_undegraded":"2023-11-19T00:40:49.630096+0000","last_fullsized":"2023-11-19T00:40:49.630096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643663+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:49.643663+0000","last_peered":"2023-11-19T00:40:49.643663+0000","last_clean":"2023-11-19T00:40:49.643663+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:49.643663+0000","last_undegraded":"2023-11-19T00:40:49.643663+0000","last_fullsized":"2023-11-19T00:40:49.643663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":442,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629589+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:49.629589+0000","last_peered":"2023-11-19T00:40:49.629589+0000","last_clean":"2023-11-19T00:40:49.629589+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:49.629589+0000","last_undegraded":"2023-11-19T00:40:49.629589+0000","last_fullsized":"2023-11-19T00:40:49.629589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628701+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:49.628701+0000","last_peered":"2023-11-19T00:40:49.628701+0000","last_clean":"2023-11-19T00:40:49.628701+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:49.628701+0000","last_undegraded":"2023-11-19T00:40:49.628701+0000","last_fullsized":"2023-11-19T00:40:49.628701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630587+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:49.630587+0000","last_peered":"2023-11-19T00:40:49.630587+0000","last_clean":"2023-11-19T00:40:49.630587+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:49.630587+0000","last_undegraded":"2023-11-19T00:40:49.630587+0000","last_fullsized":"2023-11-19T00:40:49.630587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.640059+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:49.640059+0000","last_peered":"2023-11-19T00:40:49.640059+0000","last_clean":"2023-11-19T00:40:49.640059+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:49.640059+0000","last_undegraded":"2023-11-19T00:40:49.640059+0000","last_fullsized":"2023-11-19T00:40:49.640059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630153+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:49.630153+0000","last_peered":"2023-11-19T00:40:49.630153+0000","last_clean":"2023-11-19T00:40:49.630153+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:49.630153+0000","last_undegraded":"2023-11-19T00:40:49.630153+0000","last_fullsized":"2023-11-19T00:40:49.630153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":238,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627896+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:49.627896+0000","last_peered":"2023-11-19T00:40:49.627896+0000","last_clean":"2023-11-19T00:40:49.627896+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:49.627896+0000","last_undegraded":"2023-11-19T00:40:49.627896+0000","last_fullsized":"2023-11-19T00:40:49.627896+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628582+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:49.628582+0000","last_peered":"2023-11-19T00:40:49.628582+0000","last_clean":"2023-11-19T00:40:49.628582+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:49.628582+0000","last_undegraded":"2023-11-19T00:40:49.628582+0000","last_fullsized":"2023-11-19T00:40:49.628582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":687,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647554+0000","last_change":"2023-11-19T00:40:49.647066+0000","last_active":"2023-11-19T00:40:49.647554+0000","last_peered":"2023-11-19T00:40:49.647554+0000","last_clean":"2023-11-19T00:40:49.647554+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:40:49.647554+0000","last_undegraded":"2023-11-19T00:40:49.647554+0000","last_fullsized":"2023-11-19T00:40:49.647554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:51:07.279809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628388+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:49.628388+0000","last_peered":"2023-11-19T00:40:49.628388+0000","last_clean":"2023-11-19T00:40:49.628388+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:49.628388+0000","last_undegraded":"2023-11-19T00:40:49.628388+0000","last_fullsized":"2023-11-19T00:40:49.628388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":189,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649532+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:40:49.649532+0000","last_peered":"2023-11-19T00:40:49.649532+0000","last_clean":"2023-11-19T00:40:49.649532+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:40:49.649532+0000","last_undegraded":"2023-11-19T00:40:49.649532+0000","last_fullsized":"2023-11-19T00:40:49.649532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:25.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650896+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:40:49.650896+0000","last_peered":"2023-11-19T00:40:49.650896+0000","last_clean":"2023-11-19T00:40:49.650896+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:40:49.650896+0000","last_undegraded":"2023-11-19T00:40:49.650896+0000","last_fullsized":"2023-11-19T00:40:49.650896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:30.721704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":212,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650648+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:40:49.650648+0000","last_peered":"2023-11-19T00:40:49.650648+0000","last_clean":"2023-11-19T00:40:49.650648+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:40:49.650648+0000","last_undegraded":"2023-11-19T00:40:49.650648+0000","last_fullsized":"2023-11-19T00:40:49.650648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628523+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:49.628523+0000","last_peered":"2023-11-19T00:40:49.628523+0000","last_clean":"2023-11-19T00:40:49.628523+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:49.628523+0000","last_undegraded":"2023-11-19T00:40:49.628523+0000","last_fullsized":"2023-11-19T00:40:49.628523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627815+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:49.627815+0000","last_peered":"2023-11-19T00:40:49.627815+0000","last_clean":"2023-11-19T00:40:49.627815+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:49.627815+0000","last_undegraded":"2023-11-19T00:40:49.627815+0000","last_fullsized":"2023-11-19T00:40:49.627815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643201+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:49.643201+0000","last_peered":"2023-11-19T00:40:49.643201+0000","last_clean":"2023-11-19T00:40:49.643201+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:49.643201+0000","last_undegraded":"2023-11-19T00:40:49.643201+0000","last_fullsized":"2023-11-19T00:40:49.643201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":503,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646542+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:40:49.646542+0000","last_peered":"2023-11-19T00:40:49.646542+0000","last_clean":"2023-11-19T00:40:49.646542+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:40:49.646542+0000","last_undegraded":"2023-11-19T00:40:49.646542+0000","last_fullsized":"2023-11-19T00:40:49.646542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:11.509410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631204+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:49.631204+0000","last_peered":"2023-11-19T00:40:49.631204+0000","last_clean":"2023-11-19T00:40:49.631204+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:49.631204+0000","last_undegraded":"2023-11-19T00:40:49.631204+0000","last_fullsized":"2023-11-19T00:40:49.631204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82098443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99000,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272840,"statfs":{"total":96636764160,"available":96535388160,"internally_reserved":0,"allocated":46702592,"data_stored":39130954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101756,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270084,"statfs":{"total":96636764160,"available":96532566016,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.44}]}]},{"osd":1,"up_from":8,"seq":34359738400,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113292,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20076021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:40:58.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:40:59.046 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:40:59.046 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":75,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:40:50.624970+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:41:00.059 INFO:tasks.ceph:Scrubbing osd.0 2023-11-19T00:41:00.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-19T00:41:00.238 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:41:00.238 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-19T00:41:00.238 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:41:00.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-19T00:41:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2023-11-19T00:41:00.558 INFO:tasks.ceph:Scrubbing osd.1 2023-11-19T00:41:00.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-19T00:41:00.690 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:41:00.691 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-19T00:41:00.691 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:41:00.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-19T00:41:00.995 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2023-11-19T00:41:01.007 INFO:tasks.ceph:Scrubbing osd.2 2023-11-19T00:41:01.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-19T00:41:01.139 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-11-19T00:41:01.139 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-19T00:41:01.139 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-11-19T00:41:01.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-19T00:41:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2023-11-19T00:41:01.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:41:01.755 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:41:01.756 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:41:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-11-19T00:41:01.048844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10821,"ondisk_log_size":10821,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314048,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801472,"statfs":{"total":289910292480,"available":289588707328,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1653,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-321,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":901959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.422164"},"pg_stats":[{"pgid":"4.3f","version":"59'165","reported_seq":450,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628335+0000","last_change":"2023-11-19T00:40:47.645008+0000","last_active":"2023-11-19T00:40:49.628335+0000","last_peered":"2023-11-19T00:40:49.628335+0000","last_clean":"2023-11-19T00:40:49.628335+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:40:49.628335+0000","last_undegraded":"2023-11-19T00:40:49.628335+0000","last_fullsized":"2023-11-19T00:40:49.628335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:34:27.531110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":225,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627893+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:49.627893+0000","last_peered":"2023-11-19T00:40:49.627893+0000","last_clean":"2023-11-19T00:40:49.627893+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:49.627893+0000","last_undegraded":"2023-11-19T00:40:49.627893+0000","last_fullsized":"2023-11-19T00:40:49.627893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:41:37.292261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641372+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:49.641372+0000","last_peered":"2023-11-19T00:40:49.641372+0000","last_clean":"2023-11-19T00:40:49.641372+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:49.641372+0000","last_undegraded":"2023-11-19T00:40:49.641372+0000","last_fullsized":"2023-11-19T00:40:49.641372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:12.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'121","reported_seq":170,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650672+0000","last_change":"2023-11-19T00:40:49.649721+0000","last_active":"2023-11-19T00:40:49.650672+0000","last_peered":"2023-11-19T00:40:49.650672+0000","last_clean":"2023-11-19T00:40:49.650672+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:40:49.650672+0000","last_undegraded":"2023-11-19T00:40:49.650672+0000","last_fullsized":"2023-11-19T00:40:49.650672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:49:37.114888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":497,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632731+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:50.632731+0000","last_peered":"2023-11-19T00:40:50.632731+0000","last_clean":"2023-11-19T00:40:50.632731+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:50.632731+0000","last_undegraded":"2023-11-19T00:40:50.632731+0000","last_fullsized":"2023-11-19T00:40:50.632731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:47:47.863702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":452,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650631+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:40:49.650631+0000","last_peered":"2023-11-19T00:40:49.650631+0000","last_clean":"2023-11-19T00:40:49.650631+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:40:49.650631+0000","last_undegraded":"2023-11-19T00:40:49.650631+0000","last_fullsized":"2023-11-19T00:40:49.650631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:58.153284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":216,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646821+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:40:49.646821+0000","last_peered":"2023-11-19T00:40:49.646821+0000","last_clean":"2023-11-19T00:40:49.646821+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:40:49.646821+0000","last_undegraded":"2023-11-19T00:40:49.646821+0000","last_fullsized":"2023-11-19T00:40:49.646821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:27.819649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":367,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646895+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:40:49.646895+0000","last_peered":"2023-11-19T00:40:49.646895+0000","last_clean":"2023-11-19T00:40:49.646895+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:40:49.646895+0000","last_undegraded":"2023-11-19T00:40:49.646895+0000","last_fullsized":"2023-11-19T00:40:49.646895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:28:17.058785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'169","reported_seq":236,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643199+0000","last_change":"2023-11-19T00:38:44.776496+0000","last_active":"2023-11-19T00:40:49.643199+0000","last_peered":"2023-11-19T00:40:49.643199+0000","last_clean":"2023-11-19T00:40:49.643199+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:40:49.643199+0000","last_undegraded":"2023-11-19T00:40:49.643199+0000","last_fullsized":"2023-11-19T00:40:49.643199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:12:41.828663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":411,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.644989+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:49.644989+0000","last_peered":"2023-11-19T00:40:49.644989+0000","last_clean":"2023-11-19T00:40:49.644989+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:49.644989+0000","last_undegraded":"2023-11-19T00:40:49.644989+0000","last_fullsized":"2023-11-19T00:40:49.644989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:44:32.870644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"62'159","reported_seq":454,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.645206+0000","last_change":"2023-11-19T00:40:49.644469+0000","last_active":"2023-11-19T00:40:49.645206+0000","last_peered":"2023-11-19T00:40:49.645206+0000","last_clean":"2023-11-19T00:40:49.645206+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:40:49.645206+0000","last_undegraded":"2023-11-19T00:40:49.645206+0000","last_fullsized":"2023-11-19T00:40:49.645206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":210,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628929+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:40:49.628929+0000","last_peered":"2023-11-19T00:40:49.628929+0000","last_clean":"2023-11-19T00:40:49.628929+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:40:49.628929+0000","last_undegraded":"2023-11-19T00:40:49.628929+0000","last_fullsized":"2023-11-19T00:40:49.628929+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:46.075864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"60'133","reported_seq":571,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628623+0000","last_change":"2023-11-19T00:40:47.641359+0000","last_active":"2023-11-19T00:40:49.628623+0000","last_peered":"2023-11-19T00:40:49.628623+0000","last_clean":"2023-11-19T00:40:49.628623+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:40:49.628623+0000","last_undegraded":"2023-11-19T00:40:49.628623+0000","last_fullsized":"2023-11-19T00:40:49.628623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:57.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":669,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639473+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:40:49.639473+0000","last_peered":"2023-11-19T00:40:49.639473+0000","last_clean":"2023-11-19T00:40:49.639473+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:40:49.639473+0000","last_undegraded":"2023-11-19T00:40:49.639473+0000","last_fullsized":"2023-11-19T00:40:49.639473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:28.029932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.636177+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:40:49.636177+0000","last_peered":"2023-11-19T00:40:49.636177+0000","last_clean":"2023-11-19T00:40:49.636177+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:40:49.636177+0000","last_undegraded":"2023-11-19T00:40:49.636177+0000","last_fullsized":"2023-11-19T00:40:49.636177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:48:06.968931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":228,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646944+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:40:49.646944+0000","last_peered":"2023-11-19T00:40:49.646944+0000","last_clean":"2023-11-19T00:40:49.646944+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:40:49.646944+0000","last_undegraded":"2023-11-19T00:40:49.646944+0000","last_fullsized":"2023-11-19T00:40:49.646944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:51.342591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643466+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:40:49.643466+0000","last_peered":"2023-11-19T00:40:49.643466+0000","last_clean":"2023-11-19T00:40:49.643466+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:40:49.643466+0000","last_undegraded":"2023-11-19T00:40:49.643466+0000","last_fullsized":"2023-11-19T00:40:49.643466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:41:22.358375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"59'152","reported_seq":426,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628168+0000","last_change":"2023-11-19T00:40:47.643026+0000","last_active":"2023-11-19T00:40:49.628168+0000","last_peered":"2023-11-19T00:40:49.628168+0000","last_clean":"2023-11-19T00:40:49.628168+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:40:49.628168+0000","last_undegraded":"2023-11-19T00:40:49.628168+0000","last_fullsized":"2023-11-19T00:40:49.628168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:53.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":416,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630248+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:49.630248+0000","last_peered":"2023-11-19T00:40:49.630248+0000","last_clean":"2023-11-19T00:40:49.630248+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:49.630248+0000","last_undegraded":"2023-11-19T00:40:49.630248+0000","last_fullsized":"2023-11-19T00:40:49.630248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"59'165","reported_seq":213,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650928+0000","last_change":"2023-11-19T00:40:49.650228+0000","last_active":"2023-11-19T00:40:49.650928+0000","last_peered":"2023-11-19T00:40:49.650928+0000","last_clean":"2023-11-19T00:40:49.650928+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:40:49.650928+0000","last_undegraded":"2023-11-19T00:40:49.650928+0000","last_fullsized":"2023-11-19T00:40:49.650928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:21:23.620456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'162","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649923+0000","last_change":"2023-11-19T00:40:49.648626+0000","last_active":"2023-11-19T00:40:49.649923+0000","last_peered":"2023-11-19T00:40:49.649923+0000","last_clean":"2023-11-19T00:40:49.649923+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:40:49.649923+0000","last_undegraded":"2023-11-19T00:40:49.649923+0000","last_fullsized":"2023-11-19T00:40:49.649923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:06.941251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":233,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627938+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:40:49.627938+0000","last_peered":"2023-11-19T00:40:49.627938+0000","last_clean":"2023-11-19T00:40:49.627938+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:40:49.627938+0000","last_undegraded":"2023-11-19T00:40:49.627938+0000","last_fullsized":"2023-11-19T00:40:49.627938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:46:31.003328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":218,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630008+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:40:49.630008+0000","last_peered":"2023-11-19T00:40:49.630008+0000","last_clean":"2023-11-19T00:40:49.630008+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:40:49.630008+0000","last_undegraded":"2023-11-19T00:40:49.630008+0000","last_fullsized":"2023-11-19T00:40:49.630008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:44.577296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":217,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628849+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:50.628849+0000","last_peered":"2023-11-19T00:40:50.628849+0000","last_clean":"2023-11-19T00:40:50.628849+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:50.628849+0000","last_undegraded":"2023-11-19T00:40:50.628849+0000","last_fullsized":"2023-11-19T00:40:50.628849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:07.455086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":248,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628440+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:49.628440+0000","last_peered":"2023-11-19T00:40:49.628440+0000","last_clean":"2023-11-19T00:40:49.628440+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:49.628440+0000","last_undegraded":"2023-11-19T00:40:49.628440+0000","last_fullsized":"2023-11-19T00:40:49.628440+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:53.356380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":253,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629790+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:50.629790+0000","last_peered":"2023-11-19T00:40:50.629790+0000","last_clean":"2023-11-19T00:40:50.629790+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:50.629790+0000","last_undegraded":"2023-11-19T00:40:50.629790+0000","last_fullsized":"2023-11-19T00:40:50.629790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:49:09.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":220,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828300+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:50.828300+0000","last_peered":"2023-11-19T00:40:50.828300+0000","last_clean":"2023-11-19T00:40:50.828300+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:50.828300+0000","last_undegraded":"2023-11-19T00:40:50.828300+0000","last_fullsized":"2023-11-19T00:40:50.828300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:20.062298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"59'147","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628704+0000","last_change":"2023-11-19T00:40:37.682662+0000","last_active":"2023-11-19T00:40:49.628704+0000","last_peered":"2023-11-19T00:40:49.628704+0000","last_clean":"2023-11-19T00:40:49.628704+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:40:49.628704+0000","last_undegraded":"2023-11-19T00:40:49.628704+0000","last_fullsized":"2023-11-19T00:40:49.628704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:21:03.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":668,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632079+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:50.632079+0000","last_peered":"2023-11-19T00:40:50.632079+0000","last_clean":"2023-11-19T00:40:50.632079+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:50.632079+0000","last_undegraded":"2023-11-19T00:40:50.632079+0000","last_fullsized":"2023-11-19T00:40:50.632079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:27:44.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628930+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:50.628930+0000","last_peered":"2023-11-19T00:40:50.628930+0000","last_clean":"2023-11-19T00:40:50.628930+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:50.628930+0000","last_undegraded":"2023-11-19T00:40:50.628930+0000","last_fullsized":"2023-11-19T00:40:50.628930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:42.335846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":770,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628739+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:50.628739+0000","last_peered":"2023-11-19T00:40:50.628739+0000","last_clean":"2023-11-19T00:40:50.628739+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:50.628739+0000","last_undegraded":"2023-11-19T00:40:50.628739+0000","last_fullsized":"2023-11-19T00:40:50.628739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:56:57.316040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":232,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646921+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:49.646921+0000","last_peered":"2023-11-19T00:40:49.646921+0000","last_clean":"2023-11-19T00:40:49.646921+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:49.646921+0000","last_undegraded":"2023-11-19T00:40:49.646921+0000","last_fullsized":"2023-11-19T00:40:49.646921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:13:41.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":403,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632086+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:50.632086+0000","last_peered":"2023-11-19T00:40:50.632086+0000","last_clean":"2023-11-19T00:40:50.632086+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:50.632086+0000","last_undegraded":"2023-11-19T00:40:50.632086+0000","last_fullsized":"2023-11-19T00:40:50.632086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:49:05.688454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'138","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828060+0000","last_change":"2023-11-19T00:40:49.648913+0000","last_active":"2023-11-19T00:40:50.828060+0000","last_peered":"2023-11-19T00:40:50.828060+0000","last_clean":"2023-11-19T00:40:50.828060+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:40:50.828060+0000","last_undegraded":"2023-11-19T00:40:50.828060+0000","last_fullsized":"2023-11-19T00:40:50.828060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:37:46.312569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":472,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.632567+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:49.632567+0000","last_peered":"2023-11-19T00:40:49.632567+0000","last_clean":"2023-11-19T00:40:49.632567+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:49.632567+0000","last_undegraded":"2023-11-19T00:40:49.632567+0000","last_fullsized":"2023-11-19T00:40:49.632567+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:13:46.760399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643013+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:40:49.643013+0000","last_peered":"2023-11-19T00:40:49.643013+0000","last_clean":"2023-11-19T00:40:49.643013+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:40:49.643013+0000","last_undegraded":"2023-11-19T00:40:49.643013+0000","last_fullsized":"2023-11-19T00:40:49.643013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:07:35.212070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643410+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:40:49.643410+0000","last_peered":"2023-11-19T00:40:49.643410+0000","last_clean":"2023-11-19T00:40:49.643410+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:40:49.643410+0000","last_undegraded":"2023-11-19T00:40:49.643410+0000","last_fullsized":"2023-11-19T00:40:49.643410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:41:17.804913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627575+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:40:49.627575+0000","last_peered":"2023-11-19T00:40:49.627575+0000","last_clean":"2023-11-19T00:40:49.627575+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:40:49.627575+0000","last_undegraded":"2023-11-19T00:40:49.627575+0000","last_fullsized":"2023-11-19T00:40:49.627575+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:17:12.226033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631291+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:49.631291+0000","last_peered":"2023-11-19T00:40:49.631291+0000","last_clean":"2023-11-19T00:40:49.631291+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:49.631291+0000","last_undegraded":"2023-11-19T00:40:49.631291+0000","last_fullsized":"2023-11-19T00:40:49.631291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:24:07.878833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":98,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638935+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:40:49.638935+0000","last_peered":"2023-11-19T00:40:49.638935+0000","last_clean":"2023-11-19T00:40:49.638935+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:40:49.638935+0000","last_undegraded":"2023-11-19T00:40:49.638935+0000","last_fullsized":"2023-11-19T00:40:49.638935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638412+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:40:49.638412+0000","last_peered":"2023-11-19T00:40:49.638412+0000","last_clean":"2023-11-19T00:40:49.638412+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:40:49.638412+0000","last_undegraded":"2023-11-19T00:40:49.638412+0000","last_fullsized":"2023-11-19T00:40:49.638412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:32:07.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":237,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:11:30.943896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628327+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:40:49.628327+0000","last_peered":"2023-11-19T00:40:49.628327+0000","last_clean":"2023-11-19T00:40:49.628327+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:40:49.628327+0000","last_undegraded":"2023-11-19T00:40:49.628327+0000","last_fullsized":"2023-11-19T00:40:49.628327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:13:09.491507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":471,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627344+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:49.627344+0000","last_peered":"2023-11-19T00:40:49.627344+0000","last_clean":"2023-11-19T00:40:49.627344+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:49.627344+0000","last_undegraded":"2023-11-19T00:40:49.627344+0000","last_fullsized":"2023-11-19T00:40:49.627344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:14:02.684922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639843+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:40:49.639843+0000","last_peered":"2023-11-19T00:40:49.639843+0000","last_clean":"2023-11-19T00:40:49.639843+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:40:49.639843+0000","last_undegraded":"2023-11-19T00:40:49.639843+0000","last_fullsized":"2023-11-19T00:40:49.639843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:51.721484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'145","reported_seq":414,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827964+0000","last_change":"2023-11-19T00:40:49.645680+0000","last_active":"2023-11-19T00:40:50.827964+0000","last_peered":"2023-11-19T00:40:50.827964+0000","last_clean":"2023-11-19T00:40:50.827964+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:40:50.827964+0000","last_undegraded":"2023-11-19T00:40:50.827964+0000","last_fullsized":"2023-11-19T00:40:50.827964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:13:29.817706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650913+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:40:49.650913+0000","last_peered":"2023-11-19T00:40:49.650913+0000","last_clean":"2023-11-19T00:40:49.650913+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:40:49.650913+0000","last_undegraded":"2023-11-19T00:40:49.650913+0000","last_fullsized":"2023-11-19T00:40:49.650913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:23:16.205545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":227,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643393+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:40:49.643393+0000","last_peered":"2023-11-19T00:40:49.643393+0000","last_clean":"2023-11-19T00:40:49.643393+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:40:49.643393+0000","last_undegraded":"2023-11-19T00:40:49.643393+0000","last_fullsized":"2023-11-19T00:40:49.643393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:41:34.660878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643651+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:49.643651+0000","last_peered":"2023-11-19T00:40:49.643651+0000","last_clean":"2023-11-19T00:40:49.643651+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:49.643651+0000","last_undegraded":"2023-11-19T00:40:49.643651+0000","last_fullsized":"2023-11-19T00:40:49.643651+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:18.502375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650873+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:40:49.650873+0000","last_peered":"2023-11-19T00:40:49.650873+0000","last_clean":"2023-11-19T00:40:49.650873+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:40:49.650873+0000","last_undegraded":"2023-11-19T00:40:49.650873+0000","last_fullsized":"2023-11-19T00:40:49.650873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:20:19.506460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828256+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:50.828256+0000","last_peered":"2023-11-19T00:40:50.828256+0000","last_clean":"2023-11-19T00:40:50.828256+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:50.828256+0000","last_undegraded":"2023-11-19T00:40:50.828256+0000","last_fullsized":"2023-11-19T00:40:50.828256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:32.771756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.641360+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:40:49.641360+0000","last_peered":"2023-11-19T00:40:49.641360+0000","last_clean":"2023-11-19T00:40:49.641360+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:40:49.641360+0000","last_undegraded":"2023-11-19T00:40:49.641360+0000","last_fullsized":"2023-11-19T00:40:49.641360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:42:22.553304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628860+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:50.628860+0000","last_peered":"2023-11-19T00:40:50.628860+0000","last_clean":"2023-11-19T00:40:50.628860+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:50.628860+0000","last_undegraded":"2023-11-19T00:40:50.628860+0000","last_fullsized":"2023-11-19T00:40:50.628860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:05:07.947081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":572,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638343+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:40:49.638343+0000","last_peered":"2023-11-19T00:40:49.638343+0000","last_clean":"2023-11-19T00:40:49.638343+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:40:49.638343+0000","last_undegraded":"2023-11-19T00:40:49.638343+0000","last_fullsized":"2023-11-19T00:40:49.638343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:14:50.437778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627558+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:49.627558+0000","last_peered":"2023-11-19T00:40:49.627558+0000","last_clean":"2023-11-19T00:40:49.627558+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:49.627558+0000","last_undegraded":"2023-11-19T00:40:49.627558+0000","last_fullsized":"2023-11-19T00:40:49.627558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:33:20.034306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":207,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643289+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:40:49.643289+0000","last_peered":"2023-11-19T00:40:49.643289+0000","last_clean":"2023-11-19T00:40:49.643289+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:40:49.643289+0000","last_undegraded":"2023-11-19T00:40:49.643289+0000","last_fullsized":"2023-11-19T00:40:49.643289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:18:22.682446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":306,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638672+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:49.638672+0000","last_peered":"2023-11-19T00:40:49.638672+0000","last_clean":"2023-11-19T00:40:49.638672+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:49.638672+0000","last_undegraded":"2023-11-19T00:40:49.638672+0000","last_fullsized":"2023-11-19T00:40:49.638672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:29:51.392980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650550+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:49.650550+0000","last_peered":"2023-11-19T00:40:49.650550+0000","last_clean":"2023-11-19T00:40:49.650550+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:49.650550+0000","last_undegraded":"2023-11-19T00:40:49.650550+0000","last_fullsized":"2023-11-19T00:40:49.650550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:06:44.483221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638914+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:49.638914+0000","last_peered":"2023-11-19T00:40:49.638914+0000","last_clean":"2023-11-19T00:40:49.638914+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:49.638914+0000","last_undegraded":"2023-11-19T00:40:49.638914+0000","last_fullsized":"2023-11-19T00:40:49.638914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:38:57.791481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":427,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828679+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:50.828679+0000","last_peered":"2023-11-19T00:40:50.828679+0000","last_clean":"2023-11-19T00:40:50.828679+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:50.828679+0000","last_undegraded":"2023-11-19T00:40:50.828679+0000","last_fullsized":"2023-11-19T00:40:50.828679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:06:02.150359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638326+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:49.638326+0000","last_peered":"2023-11-19T00:40:49.638326+0000","last_clean":"2023-11-19T00:40:49.638326+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:49.638326+0000","last_undegraded":"2023-11-19T00:40:49.638326+0000","last_fullsized":"2023-11-19T00:40:49.638326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:03:04.935661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630239+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:49.630239+0000","last_peered":"2023-11-19T00:40:49.630239+0000","last_clean":"2023-11-19T00:40:49.630239+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:49.630239+0000","last_undegraded":"2023-11-19T00:40:49.630239+0000","last_fullsized":"2023-11-19T00:40:49.630239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:16:55.556506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"60'155","reported_seq":654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629568+0000","last_change":"2023-11-19T00:40:47.640338+0000","last_active":"2023-11-19T00:40:50.629568+0000","last_peered":"2023-11-19T00:40:50.629568+0000","last_clean":"2023-11-19T00:40:50.629568+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:40:50.629568+0000","last_undegraded":"2023-11-19T00:40:50.629568+0000","last_fullsized":"2023-11-19T00:40:50.629568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:08:50.517130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630478+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:49.630478+0000","last_peered":"2023-11-19T00:40:49.630478+0000","last_clean":"2023-11-19T00:40:49.630478+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:49.630478+0000","last_undegraded":"2023-11-19T00:40:49.630478+0000","last_fullsized":"2023-11-19T00:40:49.630478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:36:43.922858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":132,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628153+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:49.628153+0000","last_peered":"2023-11-19T00:40:49.628153+0000","last_clean":"2023-11-19T00:40:49.628153+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:49.628153+0000","last_undegraded":"2023-11-19T00:40:49.628153+0000","last_fullsized":"2023-11-19T00:40:49.628153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:51:44.781627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":679,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.632287+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:50.632287+0000","last_peered":"2023-11-19T00:40:50.632287+0000","last_clean":"2023-11-19T00:40:50.632287+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:50.632287+0000","last_undegraded":"2023-11-19T00:40:50.632287+0000","last_fullsized":"2023-11-19T00:40:50.632287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:52:28.650242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650608+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:49.650608+0000","last_peered":"2023-11-19T00:40:49.650608+0000","last_clean":"2023-11-19T00:40:49.650608+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:49.650608+0000","last_undegraded":"2023-11-19T00:40:49.650608+0000","last_fullsized":"2023-11-19T00:40:49.650608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:23:27.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828155+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:50.828155+0000","last_peered":"2023-11-19T00:40:50.828155+0000","last_clean":"2023-11-19T00:40:50.828155+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:50.828155+0000","last_undegraded":"2023-11-19T00:40:50.828155+0000","last_fullsized":"2023-11-19T00:40:50.828155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:37:55.011970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":455,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630841+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:49.630841+0000","last_peered":"2023-11-19T00:40:49.630841+0000","last_clean":"2023-11-19T00:40:49.630841+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:49.630841+0000","last_undegraded":"2023-11-19T00:40:49.630841+0000","last_fullsized":"2023-11-19T00:40:49.630841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:50:50.641823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828779+0000","last_change":"2023-11-19T00:40:49.644207+0000","last_active":"2023-11-19T00:40:50.828779+0000","last_peered":"2023-11-19T00:40:50.828779+0000","last_clean":"2023-11-19T00:40:50.828779+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:40:50.828779+0000","last_undegraded":"2023-11-19T00:40:50.828779+0000","last_fullsized":"2023-11-19T00:40:50.828779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:47:09.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643658+0000","last_change":"2023-11-19T00:40:31.656517+0000","last_active":"2023-11-19T00:40:49.643658+0000","last_peered":"2023-11-19T00:40:49.643658+0000","last_clean":"2023-11-19T00:40:49.643658+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:40:49.643658+0000","last_undegraded":"2023-11-19T00:40:49.643658+0000","last_fullsized":"2023-11-19T00:40:49.643658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:04.622239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":241,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.639279+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:49.639279+0000","last_peered":"2023-11-19T00:40:49.639279+0000","last_clean":"2023-11-19T00:40:49.639279+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:49.639279+0000","last_undegraded":"2023-11-19T00:40:49.639279+0000","last_fullsized":"2023-11-19T00:40:49.639279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:30:39.542692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630701+0000","last_change":"2023-11-19T00:40:44.706569+0000","last_active":"2023-11-19T00:40:49.630701+0000","last_peered":"2023-11-19T00:40:49.630701+0000","last_clean":"2023-11-19T00:40:49.630701+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:40:49.630701+0000","last_undegraded":"2023-11-19T00:40:49.630701+0000","last_fullsized":"2023-11-19T00:40:49.630701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628872+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:49.628872+0000","last_peered":"2023-11-19T00:40:49.628872+0000","last_clean":"2023-11-19T00:40:49.628872+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:49.628872+0000","last_undegraded":"2023-11-19T00:40:49.628872+0000","last_fullsized":"2023-11-19T00:40:49.628872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:42.690671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:11:43.305427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.630083+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:50.630083+0000","last_peered":"2023-11-19T00:40:50.630083+0000","last_clean":"2023-11-19T00:40:50.630083+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:50.630083+0000","last_undegraded":"2023-11-19T00:40:50.630083+0000","last_fullsized":"2023-11-19T00:40:50.630083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:12:12.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630656+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:49.630656+0000","last_peered":"2023-11-19T00:40:49.630656+0000","last_clean":"2023-11-19T00:40:49.630656+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:49.630656+0000","last_undegraded":"2023-11-19T00:40:49.630656+0000","last_fullsized":"2023-11-19T00:40:49.630656+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:01:22.800073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":223,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:49.629529+0000","last_peered":"2023-11-19T00:40:49.629529+0000","last_clean":"2023-11-19T00:40:49.629529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:49.629529+0000","last_undegraded":"2023-11-19T00:40:49.629529+0000","last_fullsized":"2023-11-19T00:40:49.629529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:50:33.775841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643295+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:49.643295+0000","last_peered":"2023-11-19T00:40:49.643295+0000","last_clean":"2023-11-19T00:40:49.643295+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:49.643295+0000","last_undegraded":"2023-11-19T00:40:49.643295+0000","last_fullsized":"2023-11-19T00:40:49.643295+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:03:19.058212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637789+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:49.637789+0000","last_peered":"2023-11-19T00:40:49.637789+0000","last_clean":"2023-11-19T00:40:49.637789+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:49.637789+0000","last_undegraded":"2023-11-19T00:40:49.637789+0000","last_fullsized":"2023-11-19T00:40:49.637789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:54.815254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":222,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627863+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:49.627863+0000","last_peered":"2023-11-19T00:40:49.627863+0000","last_clean":"2023-11-19T00:40:49.627863+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:49.627863+0000","last_undegraded":"2023-11-19T00:40:49.627863+0000","last_fullsized":"2023-11-19T00:40:49.627863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:14:55.972866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":457,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.638278+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:40:49.638278+0000","last_peered":"2023-11-19T00:40:49.638278+0000","last_clean":"2023-11-19T00:40:49.638278+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:40:49.638278+0000","last_undegraded":"2023-11-19T00:40:49.638278+0000","last_fullsized":"2023-11-19T00:40:49.638278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:51.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":118,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.637727+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:40:49.637727+0000","last_peered":"2023-11-19T00:40:49.637727+0000","last_clean":"2023-11-19T00:40:49.637727+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:40:49.637727+0000","last_undegraded":"2023-11-19T00:40:49.637727+0000","last_fullsized":"2023-11-19T00:40:49.637727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:36.800427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":627,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647647+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:40:49.647647+0000","last_peered":"2023-11-19T00:40:49.647647+0000","last_clean":"2023-11-19T00:40:49.647647+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:40:49.647647+0000","last_undegraded":"2023-11-19T00:40:49.647647+0000","last_fullsized":"2023-11-19T00:40:49.647647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:54:12.572299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:49.628637+0000","last_peered":"2023-11-19T00:40:49.628637+0000","last_clean":"2023-11-19T00:40:49.628637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:49.628637+0000","last_undegraded":"2023-11-19T00:40:49.628637+0000","last_fullsized":"2023-11-19T00:40:49.628637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:59:10.489898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.648800+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:40:49.648800+0000","last_peered":"2023-11-19T00:40:49.648800+0000","last_clean":"2023-11-19T00:40:49.648800+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:40:49.648800+0000","last_undegraded":"2023-11-19T00:40:49.648800+0000","last_fullsized":"2023-11-19T00:40:49.648800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:26:07.616172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":237,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630096+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:40:49.630096+0000","last_peered":"2023-11-19T00:40:49.630096+0000","last_clean":"2023-11-19T00:40:49.630096+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:40:49.630096+0000","last_undegraded":"2023-11-19T00:40:49.630096+0000","last_fullsized":"2023-11-19T00:40:49.630096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:08:42.169985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643663+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:40:49.643663+0000","last_peered":"2023-11-19T00:40:49.643663+0000","last_clean":"2023-11-19T00:40:49.643663+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:40:49.643663+0000","last_undegraded":"2023-11-19T00:40:49.643663+0000","last_fullsized":"2023-11-19T00:40:49.643663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:22:36.893718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":442,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.629589+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:49.629589+0000","last_peered":"2023-11-19T00:40:49.629589+0000","last_clean":"2023-11-19T00:40:49.629589+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:49.629589+0000","last_undegraded":"2023-11-19T00:40:49.629589+0000","last_fullsized":"2023-11-19T00:40:49.629589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:03:32.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":240,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628701+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:49.628701+0000","last_peered":"2023-11-19T00:40:49.628701+0000","last_clean":"2023-11-19T00:40:49.628701+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:49.628701+0000","last_undegraded":"2023-11-19T00:40:49.628701+0000","last_fullsized":"2023-11-19T00:40:49.628701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:44:13.864968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630587+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:40:49.630587+0000","last_peered":"2023-11-19T00:40:49.630587+0000","last_clean":"2023-11-19T00:40:49.630587+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:40:49.630587+0000","last_undegraded":"2023-11-19T00:40:49.630587+0000","last_fullsized":"2023-11-19T00:40:49.630587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:35:11.722988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":221,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.640059+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:49.640059+0000","last_peered":"2023-11-19T00:40:49.640059+0000","last_clean":"2023-11-19T00:40:49.640059+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:49.640059+0000","last_undegraded":"2023-11-19T00:40:49.640059+0000","last_fullsized":"2023-11-19T00:40:49.640059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:37:33.008668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.630153+0000","last_change":"2023-11-19T00:40:44.704769+0000","last_active":"2023-11-19T00:40:49.630153+0000","last_peered":"2023-11-19T00:40:49.630153+0000","last_clean":"2023-11-19T00:40:49.630153+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:40:49.630153+0000","last_undegraded":"2023-11-19T00:40:49.630153+0000","last_fullsized":"2023-11-19T00:40:49.630153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:58.830744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":238,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627896+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:40:49.627896+0000","last_peered":"2023-11-19T00:40:49.627896+0000","last_clean":"2023-11-19T00:40:49.627896+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:40:49.627896+0000","last_undegraded":"2023-11-19T00:40:49.627896+0000","last_fullsized":"2023-11-19T00:40:49.627896+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:33.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628582+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:40:49.628582+0000","last_peered":"2023-11-19T00:40:49.628582+0000","last_clean":"2023-11-19T00:40:49.628582+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:40:49.628582+0000","last_undegraded":"2023-11-19T00:40:49.628582+0000","last_fullsized":"2023-11-19T00:40:49.628582+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:38:18.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"60'167","reported_seq":687,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.647554+0000","last_change":"2023-11-19T00:40:49.647066+0000","last_active":"2023-11-19T00:40:49.647554+0000","last_peered":"2023-11-19T00:40:49.647554+0000","last_clean":"2023-11-19T00:40:49.647554+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:40:49.647554+0000","last_undegraded":"2023-11-19T00:40:49.647554+0000","last_fullsized":"2023-11-19T00:40:49.647554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:51:07.279809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628388+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:49.628388+0000","last_peered":"2023-11-19T00:40:49.628388+0000","last_clean":"2023-11-19T00:40:49.628388+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:49.628388+0000","last_undegraded":"2023-11-19T00:40:49.628388+0000","last_fullsized":"2023-11-19T00:40:49.628388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:22:28.532337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":189,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.649532+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:40:49.649532+0000","last_peered":"2023-11-19T00:40:49.649532+0000","last_clean":"2023-11-19T00:40:49.649532+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:40:49.649532+0000","last_undegraded":"2023-11-19T00:40:49.649532+0000","last_fullsized":"2023-11-19T00:40:49.649532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:36:25.761789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650896+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:40:49.650896+0000","last_peered":"2023-11-19T00:40:49.650896+0000","last_clean":"2023-11-19T00:40:49.650896+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:40:49.650896+0000","last_undegraded":"2023-11-19T00:40:49.650896+0000","last_fullsized":"2023-11-19T00:40:49.650896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:30.721704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":212,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.650648+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:40:49.650648+0000","last_peered":"2023-11-19T00:40:49.650648+0000","last_clean":"2023-11-19T00:40:49.650648+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:40:49.650648+0000","last_undegraded":"2023-11-19T00:40:49.650648+0000","last_fullsized":"2023-11-19T00:40:49.650648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:48:04.984759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.628523+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:40:49.628523+0000","last_peered":"2023-11-19T00:40:49.628523+0000","last_clean":"2023-11-19T00:40:49.628523+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:40:49.628523+0000","last_undegraded":"2023-11-19T00:40:49.628523+0000","last_fullsized":"2023-11-19T00:40:49.628523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:53.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'171","reported_seq":475,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.627815+0000","last_change":"2023-11-19T00:40:47.643283+0000","last_active":"2023-11-19T00:40:49.627815+0000","last_peered":"2023-11-19T00:40:49.627815+0000","last_clean":"2023-11-19T00:40:49.627815+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:40:49.627815+0000","last_undegraded":"2023-11-19T00:40:49.627815+0000","last_fullsized":"2023-11-19T00:40:49.627815+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:05:27.225733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.643201+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:49.643201+0000","last_peered":"2023-11-19T00:40:49.643201+0000","last_clean":"2023-11-19T00:40:49.643201+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:49.643201+0000","last_undegraded":"2023-11-19T00:40:49.643201+0000","last_fullsized":"2023-11-19T00:40:49.643201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:10.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":503,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.646542+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:40:49.646542+0000","last_peered":"2023-11-19T00:40:49.646542+0000","last_clean":"2023-11-19T00:40:49.646542+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:40:49.646542+0000","last_undegraded":"2023-11-19T00:40:49.646542+0000","last_fullsized":"2023-11-19T00:40:49.646542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:54:11.509410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"47'15","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-19T00:40:49.631204+0000","last_change":"2023-11-19T00:40:44.729404+0000","last_active":"2023-11-19T00:40:49.631204+0000","last_peered":"2023-11-19T00:40:49.631204+0000","last_clean":"2023-11-19T00:40:49.631204+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:40:49.631204+0000","last_undegraded":"2023-11-19T00:40:49.631204+0000","last_fullsized":"2023-11-19T00:40:49.631204+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:09:31.029718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10231,"ondisk_log_size":10231,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99000,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272840,"statfs":{"total":96636764160,"available":96535388160,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.41899999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101756,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270084,"statfs":{"total":96636764160,"available":96532566016,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.44}]}]},{"osd":1,"up_from":8,"seq":34359738400,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113292,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.33300000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:41:01.772 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.773 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.773 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.773 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.773 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.774 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.774 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.774 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.774 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.774 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.775 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.775 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.775 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.775 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.775 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.776 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.776 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.776 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.776 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.776 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.776 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.777 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.777 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.777 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.777 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.777 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.778 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.778 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.778 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.778 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.778 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.779 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.779 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.779 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.779 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.779 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.780 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.780 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.780 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.780 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.780 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.780 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.781 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.781 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.781 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.781 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.781 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.782 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.782 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.782 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.782 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.782 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.783 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.783 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.783 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.783 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.783 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-19T00:38:33.615993+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=33, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.783 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.784 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.784 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.784 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.784 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.784 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.785 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.785 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.785 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.785 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.785 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.786 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.786 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.786 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.786 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.786 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.787 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.787 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.787 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.787 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.787 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.788 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.788 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.788 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.788 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.788 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.788 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.789 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.789 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.789 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.789 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.789 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.790 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.790 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.790 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.790 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.790 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.791 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.791 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.791 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.791 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.791 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.791 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.792 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.792 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.792 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.792 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.792 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:01.793 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-19T00:41:21.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:41:22.110 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:41:22.112 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:41:22.121 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2023-11-19T00:41:21.053902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11509,"ondisk_log_size":11509,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314024,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801496,"statfs":{"total":289910292480,"available":289588731904,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002900"},"pg_stats":[{"pgid":"4.3f","version":"75'215","reported_seq":511,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.015170+0000","last_change":"2023-11-19T00:41:12.015195+0000","last_active":"2023-11-19T00:41:12.015170+0000","last_peered":"2023-11-19T00:41:12.015170+0000","last_clean":"2023-11-19T00:41:12.015170+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:41:12.015170+0000","last_undegraded":"2023-11-19T00:41:12.015170+0000","last_fullsized":"2023-11-19T00:41:12.015170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.015097+0000","objects_scrubbed":50,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:27.053797+0000","scrub_duration":0.036690850999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":226,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629517+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:50.629517+0000","last_peered":"2023-11-19T00:40:50.629517+0000","last_clean":"2023-11-19T00:40:50.629517+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:50.629517+0000","last_undegraded":"2023-11-19T00:40:50.629517+0000","last_fullsized":"2023-11-19T00:40:50.629517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828057+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:50.828057+0000","last_peered":"2023-11-19T00:40:50.828057+0000","last_clean":"2023-11-19T00:40:50.828057+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:50.828057+0000","last_undegraded":"2023-11-19T00:40:50.828057+0000","last_fullsized":"2023-11-19T00:40:50.828057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"75'172","reported_seq":232,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:10.950084+0000","last_change":"2023-11-19T00:41:10.950107+0000","last_active":"2023-11-19T00:41:10.950084+0000","last_peered":"2023-11-19T00:41:10.950084+0000","last_clean":"2023-11-19T00:41:10.950084+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:41:10.950084+0000","last_undegraded":"2023-11-19T00:41:10.950084+0000","last_fullsized":"2023-11-19T00:41:10.950084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'172","last_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_deep_scrub":"75'172","last_deep_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_clean_scrub_stamp":"2023-11-19T00:41:10.950010+0000","objects_scrubbed":51,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:03.687754+0000","scrub_duration":0.034903271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":498,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629503+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:51.629503+0000","last_peered":"2023-11-19T00:40:51.629503+0000","last_clean":"2023-11-19T00:40:51.629503+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:51.629503+0000","last_undegraded":"2023-11-19T00:40:51.629503+0000","last_fullsized":"2023-11-19T00:40:51.629503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":454,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443783+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:41:01.443783+0000","last_peered":"2023-11-19T00:41:01.443783+0000","last_clean":"2023-11-19T00:41:01.443783+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:41:01.443783+0000","last_undegraded":"2023-11-19T00:41:01.443783+0000","last_fullsized":"2023-11-19T00:41:01.443783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":218,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443735+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:41:01.443735+0000","last_peered":"2023-11-19T00:41:01.443735+0000","last_clean":"2023-11-19T00:41:01.443735+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:41:01.443735+0000","last_undegraded":"2023-11-19T00:41:01.443735+0000","last_fullsized":"2023-11-19T00:41:01.443735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":369,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443719+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:41:01.443719+0000","last_peered":"2023-11-19T00:41:01.443719+0000","last_clean":"2023-11-19T00:41:01.443719+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:41:01.443719+0000","last_undegraded":"2023-11-19T00:41:01.443719+0000","last_fullsized":"2023-11-19T00:41:01.443719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.238253+0000","last_change":"2023-11-19T00:41:08.238253+0000","last_active":"2023-11-19T00:41:08.238253+0000","last_peered":"2023-11-19T00:41:08.238253+0000","last_clean":"2023-11-19T00:41:08.238253+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:41:08.238253+0000","last_undegraded":"2023-11-19T00:41:08.238253+0000","last_fullsized":"2023-11-19T00:41:08.238253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.238154+0000","objects_scrubbed":51,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:28:28.657653+0000","scrub_duration":0.035756160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":412,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629401+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:50.629401+0000","last_peered":"2023-11-19T00:40:50.629401+0000","last_clean":"2023-11-19T00:40:50.629401+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:50.629401+0000","last_undegraded":"2023-11-19T00:40:50.629401+0000","last_fullsized":"2023-11-19T00:40:50.629401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"75'215","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.969246+0000","last_change":"2023-11-19T00:41:15.969271+0000","last_active":"2023-11-19T00:41:15.969246+0000","last_peered":"2023-11-19T00:41:15.969246+0000","last_clean":"2023-11-19T00:41:15.969246+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:41:15.969246+0000","last_undegraded":"2023-11-19T00:41:15.969246+0000","last_fullsized":"2023-11-19T00:41:15.969246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.969180+0000","objects_scrubbed":56,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:37:03.160511+0000","scrub_duration":0.046149739000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995814+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:41:00.995814+0000","last_peered":"2023-11-19T00:41:00.995814+0000","last_clean":"2023-11-19T00:41:00.995814+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:41:00.995814+0000","last_undegraded":"2023-11-19T00:41:00.995814+0000","last_fullsized":"2023-11-19T00:41:00.995814+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"75'183","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:09.037090+0000","last_change":"2023-11-19T00:41:09.037113+0000","last_active":"2023-11-19T00:41:09.037090+0000","last_peered":"2023-11-19T00:41:09.037090+0000","last_clean":"2023-11-19T00:41:09.037090+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:41:09.037090+0000","last_undegraded":"2023-11-19T00:41:09.037090+0000","last_fullsized":"2023-11-19T00:41:09.037090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'183","last_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_deep_scrub":"75'183","last_deep_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_clean_scrub_stamp":"2023-11-19T00:41:09.037014+0000","objects_scrubbed":50,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:26.814001+0000","scrub_duration":0.033302804999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":671,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443757+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:41:01.443757+0000","last_peered":"2023-11-19T00:41:01.443757+0000","last_clean":"2023-11-19T00:41:01.443757+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:41:01.443757+0000","last_undegraded":"2023-11-19T00:41:01.443757+0000","last_fullsized":"2023-11-19T00:41:01.443757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":229,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443708+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:41:01.443708+0000","last_peered":"2023-11-19T00:41:01.443708+0000","last_clean":"2023-11-19T00:41:01.443708+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:41:01.443708+0000","last_undegraded":"2023-11-19T00:41:01.443708+0000","last_fullsized":"2023-11-19T00:41:01.443708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":230,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443677+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:41:01.443677+0000","last_peered":"2023-11-19T00:41:01.443677+0000","last_clean":"2023-11-19T00:41:01.443677+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:41:01.443677+0000","last_undegraded":"2023-11-19T00:41:01.443677+0000","last_fullsized":"2023-11-19T00:41:01.443677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":223,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546127+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:41:00.546127+0000","last_peered":"2023-11-19T00:41:00.546127+0000","last_clean":"2023-11-19T00:41:00.546127+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:41:00.546127+0000","last_undegraded":"2023-11-19T00:41:00.546127+0000","last_fullsized":"2023-11-19T00:41:00.546127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"75'199","reported_seq":483,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.090823+0000","last_change":"2023-11-19T00:41:03.090862+0000","last_active":"2023-11-19T00:41:03.090823+0000","last_peered":"2023-11-19T00:41:03.090823+0000","last_clean":"2023-11-19T00:41:03.090823+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:41:03.090823+0000","last_undegraded":"2023-11-19T00:41:03.090823+0000","last_fullsized":"2023-11-19T00:41:03.090823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.090716+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:42.528537+0000","scrub_duration":0.045074112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":417,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629306+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:50.629306+0000","last_peered":"2023-11-19T00:40:50.629306+0000","last_clean":"2023-11-19T00:40:50.629306+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:50.629306+0000","last_undegraded":"2023-11-19T00:40:50.629306+0000","last_fullsized":"2023-11-19T00:40:50.629306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"75'221","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.963592+0000","last_change":"2023-11-19T00:41:04.963623+0000","last_active":"2023-11-19T00:41:04.963592+0000","last_peered":"2023-11-19T00:41:04.963592+0000","last_clean":"2023-11-19T00:41:04.963592+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:41:04.963592+0000","last_undegraded":"2023-11-19T00:41:04.963592+0000","last_fullsized":"2023-11-19T00:41:04.963592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.963516+0000","objects_scrubbed":56,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:06.799626+0000","scrub_duration":0.039865746000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"75'217","reported_seq":275,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.942577+0000","last_change":"2023-11-19T00:41:12.942606+0000","last_active":"2023-11-19T00:41:12.942577+0000","last_peered":"2023-11-19T00:41:12.942577+0000","last_clean":"2023-11-19T00:41:12.942577+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:41:12.942577+0000","last_undegraded":"2023-11-19T00:41:12.942577+0000","last_fullsized":"2023-11-19T00:41:12.942577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'217","last_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_deep_scrub":"75'217","last_deep_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.942504+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:29.802215+0000","scrub_duration":0.042793523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":235,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995776+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:41:00.995776+0000","last_peered":"2023-11-19T00:41:00.995776+0000","last_clean":"2023-11-19T00:41:00.995776+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:41:00.995776+0000","last_undegraded":"2023-11-19T00:41:00.995776+0000","last_fullsized":"2023-11-19T00:41:00.995776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":220,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546042+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:41:00.546042+0000","last_peered":"2023-11-19T00:41:00.546042+0000","last_clean":"2023-11-19T00:41:00.546042+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:41:00.546042+0000","last_undegraded":"2023-11-19T00:41:00.546042+0000","last_fullsized":"2023-11-19T00:41:00.546042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":218,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630031+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:56.630031+0000","last_peered":"2023-11-19T00:40:56.630031+0000","last_clean":"2023-11-19T00:40:56.630031+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:56.630031+0000","last_undegraded":"2023-11-19T00:40:56.630031+0000","last_fullsized":"2023-11-19T00:40:56.630031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"59'160","reported_seq":249,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629711+0000","last_change":"2023-11-19T00:40:36.674836+0000","last_active":"2023-11-19T00:40:50.629711+0000","last_peered":"2023-11-19T00:40:50.629711+0000","last_clean":"2023-11-19T00:40:50.629711+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:40:50.629711+0000","last_undegraded":"2023-11-19T00:40:50.629711+0000","last_fullsized":"2023-11-19T00:40:50.629711+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"59'185","reported_seq":254,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:58.634057+0000","last_change":"2023-11-19T00:38:44.772610+0000","last_active":"2023-11-19T00:40:58.634057+0000","last_peered":"2023-11-19T00:40:58.634057+0000","last_clean":"2023-11-19T00:40:58.634057+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:40:58.634057+0000","last_undegraded":"2023-11-19T00:40:58.634057+0000","last_fullsized":"2023-11-19T00:40:58.634057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":221,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632476+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:56.632476+0000","last_peered":"2023-11-19T00:40:56.632476+0000","last_clean":"2023-11-19T00:40:56.632476+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:56.632476+0000","last_undegraded":"2023-11-19T00:40:56.632476+0000","last_fullsized":"2023-11-19T00:40:56.632476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"75'195","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:14.991821+0000","last_change":"2023-11-19T00:41:14.991861+0000","last_active":"2023-11-19T00:41:14.991821+0000","last_peered":"2023-11-19T00:41:14.991821+0000","last_clean":"2023-11-19T00:41:14.991821+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:41:14.991821+0000","last_undegraded":"2023-11-19T00:41:14.991821+0000","last_fullsized":"2023-11-19T00:41:14.991821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'195","last_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_deep_scrub":"75'195","last_deep_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_clean_scrub_stamp":"2023-11-19T00:41:14.991747+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:33.385240+0000","scrub_duration":0.031971732000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":669,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633329+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:53.633329+0000","last_peered":"2023-11-19T00:40:53.633329+0000","last_clean":"2023-11-19T00:40:53.633329+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:53.633329+0000","last_undegraded":"2023-11-19T00:40:53.633329+0000","last_fullsized":"2023-11-19T00:40:53.633329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":268,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629483+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:51.629483+0000","last_peered":"2023-11-19T00:40:51.629483+0000","last_clean":"2023-11-19T00:40:51.629483+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:51.629483+0000","last_undegraded":"2023-11-19T00:40:51.629483+0000","last_fullsized":"2023-11-19T00:40:51.629483+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633231+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:53.633231+0000","last_peered":"2023-11-19T00:40:53.633231+0000","last_clean":"2023-11-19T00:40:53.633231+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:53.633231+0000","last_undegraded":"2023-11-19T00:40:53.633231+0000","last_fullsized":"2023-11-19T00:40:53.633231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":233,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827418+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:50.827418+0000","last_peered":"2023-11-19T00:40:50.827418+0000","last_clean":"2023-11-19T00:40:50.827418+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:50.827418+0000","last_undegraded":"2023-11-19T00:40:50.827418+0000","last_fullsized":"2023-11-19T00:40:50.827418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":404,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629535+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:51.629535+0000","last_peered":"2023-11-19T00:40:51.629535+0000","last_clean":"2023-11-19T00:40:51.629535+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:51.629535+0000","last_undegraded":"2023-11-19T00:40:51.629535+0000","last_fullsized":"2023-11-19T00:40:51.629535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'140","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.861697+0000","last_change":"2023-11-19T00:41:08.861726+0000","last_active":"2023-11-19T00:41:08.861697+0000","last_peered":"2023-11-19T00:41:08.861697+0000","last_clean":"2023-11-19T00:41:08.861697+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:41:08.861697+0000","last_undegraded":"2023-11-19T00:41:08.861697+0000","last_fullsized":"2023-11-19T00:41:08.861697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'140","last_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_deep_scrub":"75'140","last_deep_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.861626+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:02.346222+0000","scrub_duration":0.0096612360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":473,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629510+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:50.629510+0000","last_peered":"2023-11-19T00:40:50.629510+0000","last_clean":"2023-11-19T00:40:50.629510+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:50.629510+0000","last_undegraded":"2023-11-19T00:40:50.629510+0000","last_fullsized":"2023-11-19T00:40:50.629510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545690+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:41:00.545690+0000","last_peered":"2023-11-19T00:41:00.545690+0000","last_clean":"2023-11-19T00:41:00.545690+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:41:00.545690+0000","last_undegraded":"2023-11-19T00:41:00.545690+0000","last_fullsized":"2023-11-19T00:41:00.545690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":242,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545982+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:41:00.545982+0000","last_peered":"2023-11-19T00:41:00.545982+0000","last_clean":"2023-11-19T00:41:00.545982+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:41:00.545982+0000","last_undegraded":"2023-11-19T00:41:00.545982+0000","last_fullsized":"2023-11-19T00:41:00.545982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995393+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:41:00.995393+0000","last_peered":"2023-11-19T00:41:00.995393+0000","last_clean":"2023-11-19T00:41:00.995393+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:41:00.995393+0000","last_undegraded":"2023-11-19T00:41:00.995393+0000","last_fullsized":"2023-11-19T00:41:00.995393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":210,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629528+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:50.629528+0000","last_peered":"2023-11-19T00:40:50.629528+0000","last_clean":"2023-11-19T00:40:50.629528+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:50.629528+0000","last_undegraded":"2023-11-19T00:40:50.629528+0000","last_fullsized":"2023-11-19T00:40:50.629528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":100,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443360+0000","last_change":"2023-11-19T00:40:49.638044+0000","last_active":"2023-11-19T00:41:01.443360+0000","last_peered":"2023-11-19T00:41:01.443360+0000","last_clean":"2023-11-19T00:41:01.443360+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:41:01.443360+0000","last_undegraded":"2023-11-19T00:41:01.443360+0000","last_fullsized":"2023-11-19T00:41:01.443360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443351+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:41:01.443351+0000","last_peered":"2023-11-19T00:41:01.443351+0000","last_clean":"2023-11-19T00:41:01.443351+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:41:01.443351+0000","last_undegraded":"2023-11-19T00:41:01.443351+0000","last_fullsized":"2023-11-19T00:41:01.443351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":238,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630043+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:56.630043+0000","last_peered":"2023-11-19T00:40:56.630043+0000","last_clean":"2023-11-19T00:40:56.630043+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:56.630043+0000","last_undegraded":"2023-11-19T00:40:56.630043+0000","last_fullsized":"2023-11-19T00:40:56.630043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995362+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:41:00.995362+0000","last_peered":"2023-11-19T00:41:00.995362+0000","last_clean":"2023-11-19T00:41:00.995362+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:41:00.995362+0000","last_undegraded":"2023-11-19T00:41:00.995362+0000","last_fullsized":"2023-11-19T00:41:00.995362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":472,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628607+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:50.628607+0000","last_peered":"2023-11-19T00:40:50.628607+0000","last_clean":"2023-11-19T00:40:50.628607+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:50.628607+0000","last_undegraded":"2023-11-19T00:40:50.628607+0000","last_fullsized":"2023-11-19T00:40:50.628607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443334+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:41:01.443334+0000","last_peered":"2023-11-19T00:41:01.443334+0000","last_clean":"2023-11-19T00:41:01.443334+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:41:01.443334+0000","last_undegraded":"2023-11-19T00:41:01.443334+0000","last_fullsized":"2023-11-19T00:41:01.443334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"75'201","reported_seq":481,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.932131+0000","last_change":"2023-11-19T00:41:07.932168+0000","last_active":"2023-11-19T00:41:07.932131+0000","last_peered":"2023-11-19T00:41:07.932131+0000","last_clean":"2023-11-19T00:41:07.932131+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:41:07.932131+0000","last_undegraded":"2023-11-19T00:41:07.932131+0000","last_fullsized":"2023-11-19T00:41:07.932131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'201","last_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_deep_scrub":"75'201","last_deep_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.932043+0000","objects_scrubbed":56,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:52:53.830915+0000","scrub_duration":0.040909213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443304+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:41:01.443304+0000","last_peered":"2023-11-19T00:41:01.443304+0000","last_clean":"2023-11-19T00:41:01.443304+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:41:01.443304+0000","last_undegraded":"2023-11-19T00:41:01.443304+0000","last_fullsized":"2023-11-19T00:41:01.443304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":229,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545938+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:41:00.545938+0000","last_peered":"2023-11-19T00:41:00.545938+0000","last_clean":"2023-11-19T00:41:00.545938+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:41:00.545938+0000","last_undegraded":"2023-11-19T00:41:00.545938+0000","last_fullsized":"2023-11-19T00:41:00.545938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'22","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629529+0000","last_change":"2023-11-19T00:40:44.748624+0000","last_active":"2023-11-19T00:40:50.629529+0000","last_peered":"2023-11-19T00:40:50.629529+0000","last_clean":"2023-11-19T00:40:50.629529+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:40:50.629529+0000","last_undegraded":"2023-11-19T00:40:50.629529+0000","last_fullsized":"2023-11-19T00:40:50.629529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"59'174","reported_seq":477,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443588+0000","last_change":"2023-11-19T00:40:49.649636+0000","last_active":"2023-11-19T00:41:01.443588+0000","last_peered":"2023-11-19T00:41:01.443588+0000","last_clean":"2023-11-19T00:41:01.443588+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:41:01.443588+0000","last_undegraded":"2023-11-19T00:41:01.443588+0000","last_fullsized":"2023-11-19T00:41:01.443588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632301+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:56.632301+0000","last_peered":"2023-11-19T00:40:56.632301+0000","last_clean":"2023-11-19T00:40:56.632301+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:56.632301+0000","last_undegraded":"2023-11-19T00:40:56.632301+0000","last_fullsized":"2023-11-19T00:40:56.632301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":233,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443523+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:41:01.443523+0000","last_peered":"2023-11-19T00:41:01.443523+0000","last_clean":"2023-11-19T00:41:01.443523+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:41:01.443523+0000","last_undegraded":"2023-11-19T00:41:01.443523+0000","last_fullsized":"2023-11-19T00:41:01.443523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630074+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:56.630074+0000","last_peered":"2023-11-19T00:40:56.630074+0000","last_clean":"2023-11-19T00:40:56.630074+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:56.630074+0000","last_undegraded":"2023-11-19T00:40:56.630074+0000","last_fullsized":"2023-11-19T00:40:56.630074+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":574,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443494+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:41:01.443494+0000","last_peered":"2023-11-19T00:41:01.443494+0000","last_clean":"2023-11-19T00:41:01.443494+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:41:01.443494+0000","last_undegraded":"2023-11-19T00:41:01.443494+0000","last_fullsized":"2023-11-19T00:41:01.443494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628665+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:50.628665+0000","last_peered":"2023-11-19T00:40:50.628665+0000","last_clean":"2023-11-19T00:40:50.628665+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:50.628665+0000","last_undegraded":"2023-11-19T00:40:50.628665+0000","last_fullsized":"2023-11-19T00:40:50.628665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'140","reported_seq":209,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545951+0000","last_change":"2023-11-19T00:38:44.776054+0000","last_active":"2023-11-19T00:41:00.545951+0000","last_peered":"2023-11-19T00:41:00.545951+0000","last_clean":"2023-11-19T00:41:00.545951+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:41:00.545951+0000","last_undegraded":"2023-11-19T00:41:00.545951+0000","last_fullsized":"2023-11-19T00:41:00.545951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":307,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827812+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:50.827812+0000","last_peered":"2023-11-19T00:40:50.827812+0000","last_clean":"2023-11-19T00:40:50.827812+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:50.827812+0000","last_undegraded":"2023-11-19T00:40:50.827812+0000","last_fullsized":"2023-11-19T00:40:50.827812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828182+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:50.828182+0000","last_peered":"2023-11-19T00:40:50.828182+0000","last_clean":"2023-11-19T00:40:50.828182+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:50.828182+0000","last_undegraded":"2023-11-19T00:40:50.828182+0000","last_fullsized":"2023-11-19T00:40:50.828182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827852+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:40:50.827852+0000","last_peered":"2023-11-19T00:40:50.827852+0000","last_clean":"2023-11-19T00:40:50.827852+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:40:50.827852+0000","last_undegraded":"2023-11-19T00:40:50.827852+0000","last_fullsized":"2023-11-19T00:40:50.827852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":428,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631701+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:51.631701+0000","last_peered":"2023-11-19T00:40:51.631701+0000","last_clean":"2023-11-19T00:40:51.631701+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:51.631701+0000","last_undegraded":"2023-11-19T00:40:51.631701+0000","last_fullsized":"2023-11-19T00:40:51.631701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827672+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:50.827672+0000","last_peered":"2023-11-19T00:40:50.827672+0000","last_clean":"2023-11-19T00:40:50.827672+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:50.827672+0000","last_undegraded":"2023-11-19T00:40:50.827672+0000","last_fullsized":"2023-11-19T00:40:50.827672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":137,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629070+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:50.629070+0000","last_peered":"2023-11-19T00:40:50.629070+0000","last_clean":"2023-11-19T00:40:50.629070+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:50.629070+0000","last_undegraded":"2023-11-19T00:40:50.629070+0000","last_fullsized":"2023-11-19T00:40:50.629070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"75'208","reported_seq":718,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.122122+0000","last_change":"2023-11-19T00:41:07.122147+0000","last_active":"2023-11-19T00:41:07.122122+0000","last_peered":"2023-11-19T00:41:07.122122+0000","last_clean":"2023-11-19T00:41:07.122122+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:41:07.122122+0000","last_undegraded":"2023-11-19T00:41:07.122122+0000","last_fullsized":"2023-11-19T00:41:07.122122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'208","last_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_deep_scrub":"75'208","last_deep_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.122048+0000","objects_scrubbed":53,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:15.227402+0000","scrub_duration":0.037815080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629202+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:50.629202+0000","last_peered":"2023-11-19T00:40:50.629202+0000","last_clean":"2023-11-19T00:40:50.629202+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:50.629202+0000","last_undegraded":"2023-11-19T00:40:50.629202+0000","last_fullsized":"2023-11-19T00:40:50.629202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"47'59","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628935+0000","last_change":"2023-11-19T00:40:25.678645+0000","last_active":"2023-11-19T00:40:50.628935+0000","last_peered":"2023-11-19T00:40:50.628935+0000","last_clean":"2023-11-19T00:40:50.628935+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:40:50.628935+0000","last_undegraded":"2023-11-19T00:40:50.628935+0000","last_fullsized":"2023-11-19T00:40:50.628935+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":680,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:58.634147+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:58.634147+0000","last_peered":"2023-11-19T00:40:58.634147+0000","last_clean":"2023-11-19T00:40:58.634147+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:58.634147+0000","last_undegraded":"2023-11-19T00:40:58.634147+0000","last_fullsized":"2023-11-19T00:40:58.634147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828389+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:50.828389+0000","last_peered":"2023-11-19T00:40:50.828389+0000","last_clean":"2023-11-19T00:40:50.828389+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:50.828389+0000","last_undegraded":"2023-11-19T00:40:50.828389+0000","last_fullsized":"2023-11-19T00:40:50.828389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631576+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:51.631576+0000","last_peered":"2023-11-19T00:40:51.631576+0000","last_clean":"2023-11-19T00:40:51.631576+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:51.631576+0000","last_undegraded":"2023-11-19T00:40:51.631576+0000","last_fullsized":"2023-11-19T00:40:51.631576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":456,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629292+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:50.629292+0000","last_peered":"2023-11-19T00:40:50.629292+0000","last_clean":"2023-11-19T00:40:50.629292+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:50.629292+0000","last_undegraded":"2023-11-19T00:40:50.629292+0000","last_fullsized":"2023-11-19T00:40:50.629292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:13.930783+0000","last_change":"2023-11-19T00:41:13.930804+0000","last_active":"2023-11-19T00:41:13.930783+0000","last_peered":"2023-11-19T00:41:13.930783+0000","last_clean":"2023-11-19T00:41:13.930783+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:41:13.930783+0000","last_undegraded":"2023-11-19T00:41:13.930783+0000","last_fullsized":"2023-11-19T00:41:13.930783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_clean_scrub_stamp":"2023-11-19T00:41:13.930701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:52.200874+0000","scrub_duration":0.001907448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.394157+0000","last_change":"2023-11-19T00:41:03.394178+0000","last_active":"2023-11-19T00:41:03.394157+0000","last_peered":"2023-11-19T00:41:03.394157+0000","last_clean":"2023-11-19T00:41:03.394157+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:41:03.394157+0000","last_undegraded":"2023-11-19T00:41:03.394157+0000","last_fullsized":"2023-11-19T00:41:03.394157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.394072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:55:33.909806+0000","scrub_duration":0.0022610909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":242,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:02.407225+0000","last_change":"2023-11-19T00:41:02.407245+0000","last_active":"2023-11-19T00:41:02.407225+0000","last_peered":"2023-11-19T00:41:02.407225+0000","last_clean":"2023-11-19T00:41:02.407225+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:41:02.407225+0000","last_undegraded":"2023-11-19T00:41:02.407225+0000","last_fullsized":"2023-11-19T00:41:02.407225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_clean_scrub_stamp":"2023-11-19T00:41:02.407143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:08:56.907868+0000","scrub_duration":0.001710039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629814+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:50.629814+0000","last_peered":"2023-11-19T00:40:50.629814+0000","last_clean":"2023-11-19T00:40:50.629814+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:50.629814+0000","last_undegraded":"2023-11-19T00:40:50.629814+0000","last_fullsized":"2023-11-19T00:40:50.629814+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":250,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629525+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:51.629525+0000","last_peered":"2023-11-19T00:40:51.629525+0000","last_clean":"2023-11-19T00:40:51.629525+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:51.629525+0000","last_undegraded":"2023-11-19T00:40:51.629525+0000","last_fullsized":"2023-11-19T00:40:51.629525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633535+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:53.633535+0000","last_peered":"2023-11-19T00:40:53.633535+0000","last_clean":"2023-11-19T00:40:53.633535+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:53.633535+0000","last_undegraded":"2023-11-19T00:40:53.633535+0000","last_fullsized":"2023-11-19T00:40:53.633535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629432+0000","last_change":"2023-11-19T00:40:44.706702+0000","last_active":"2023-11-19T00:40:50.629432+0000","last_peered":"2023-11-19T00:40:50.629432+0000","last_clean":"2023-11-19T00:40:50.629432+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:40:50.629432+0000","last_undegraded":"2023-11-19T00:40:50.629432+0000","last_fullsized":"2023-11-19T00:40:50.629432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:50.628529+0000","last_peered":"2023-11-19T00:40:50.628529+0000","last_clean":"2023-11-19T00:40:50.628529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:50.628529+0000","last_undegraded":"2023-11-19T00:40:50.628529+0000","last_fullsized":"2023-11-19T00:40:50.628529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629902+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:50.629902+0000","last_peered":"2023-11-19T00:40:50.629902+0000","last_clean":"2023-11-19T00:40:50.629902+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:50.629902+0000","last_undegraded":"2023-11-19T00:40:50.629902+0000","last_fullsized":"2023-11-19T00:40:50.629902+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828688+0000","last_change":"2023-11-19T00:40:49.636515+0000","last_active":"2023-11-19T00:40:50.828688+0000","last_peered":"2023-11-19T00:40:50.828688+0000","last_clean":"2023-11-19T00:40:50.828688+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:40:50.828688+0000","last_undegraded":"2023-11-19T00:40:50.828688+0000","last_fullsized":"2023-11-19T00:40:50.828688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"59'135","reported_seq":223,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628751+0000","last_change":"2023-11-19T00:40:36.674641+0000","last_active":"2023-11-19T00:40:50.628751+0000","last_peered":"2023-11-19T00:40:50.628751+0000","last_clean":"2023-11-19T00:40:50.628751+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:40:50.628751+0000","last_undegraded":"2023-11-19T00:40:50.628751+0000","last_fullsized":"2023-11-19T00:40:50.628751+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":459,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443524+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:41:01.443524+0000","last_peered":"2023-11-19T00:41:01.443524+0000","last_clean":"2023-11-19T00:41:01.443524+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:41:01.443524+0000","last_undegraded":"2023-11-19T00:41:01.443524+0000","last_fullsized":"2023-11-19T00:41:01.443524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'42","reported_seq":120,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443409+0000","last_change":"2023-11-19T00:40:49.636597+0000","last_active":"2023-11-19T00:41:01.443409+0000","last_peered":"2023-11-19T00:41:01.443409+0000","last_clean":"2023-11-19T00:41:01.443409+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:41:01.443409+0000","last_undegraded":"2023-11-19T00:41:01.443409+0000","last_fullsized":"2023-11-19T00:41:01.443409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":629,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546002+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:41:00.546002+0000","last_peered":"2023-11-19T00:41:00.546002+0000","last_clean":"2023-11-19T00:41:00.546002+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:41:00.546002+0000","last_undegraded":"2023-11-19T00:41:00.546002+0000","last_fullsized":"2023-11-19T00:41:00.546002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"54'19","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629637+0000","last_change":"2023-11-19T00:40:46.734105+0000","last_active":"2023-11-19T00:40:50.629637+0000","last_peered":"2023-11-19T00:40:50.629637+0000","last_clean":"2023-11-19T00:40:50.629637+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:40:50.629637+0000","last_undegraded":"2023-11-19T00:40:50.629637+0000","last_fullsized":"2023-11-19T00:40:50.629637+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443438+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:41:01.443438+0000","last_peered":"2023-11-19T00:41:01.443438+0000","last_clean":"2023-11-19T00:41:01.443438+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:41:01.443438+0000","last_undegraded":"2023-11-19T00:41:01.443438+0000","last_fullsized":"2023-11-19T00:41:01.443438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":239,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545941+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:41:00.545941+0000","last_peered":"2023-11-19T00:41:00.545941+0000","last_clean":"2023-11-19T00:41:00.545941+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:41:00.545941+0000","last_undegraded":"2023-11-19T00:41:00.545941+0000","last_fullsized":"2023-11-19T00:41:00.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545741+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:41:00.545741+0000","last_peered":"2023-11-19T00:41:00.545741+0000","last_clean":"2023-11-19T00:41:00.545741+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:41:00.545741+0000","last_undegraded":"2023-11-19T00:41:00.545741+0000","last_fullsized":"2023-11-19T00:41:00.545741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":443,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628520+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:50.628520+0000","last_peered":"2023-11-19T00:40:50.628520+0000","last_clean":"2023-11-19T00:40:50.628520+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:50.628520+0000","last_undegraded":"2023-11-19T00:40:50.628520+0000","last_fullsized":"2023-11-19T00:40:50.628520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629928+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:50.629928+0000","last_peered":"2023-11-19T00:40:50.629928+0000","last_clean":"2023-11-19T00:40:50.629928+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:50.629928+0000","last_undegraded":"2023-11-19T00:40:50.629928+0000","last_fullsized":"2023-11-19T00:40:50.629928+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545752+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:41:00.545752+0000","last_peered":"2023-11-19T00:41:00.545752+0000","last_clean":"2023-11-19T00:41:00.545752+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:41:00.545752+0000","last_undegraded":"2023-11-19T00:41:00.545752+0000","last_fullsized":"2023-11-19T00:41:00.545752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"59'153","reported_seq":222,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629673+0000","last_change":"2023-11-19T00:38:44.777653+0000","last_active":"2023-11-19T00:40:50.629673+0000","last_peered":"2023-11-19T00:40:50.629673+0000","last_clean":"2023-11-19T00:40:50.629673+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:40:50.629673+0000","last_undegraded":"2023-11-19T00:40:50.629673+0000","last_fullsized":"2023-11-19T00:40:50.629673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:06.281328+0000","last_change":"2023-11-19T00:41:06.281350+0000","last_active":"2023-11-19T00:41:06.281328+0000","last_peered":"2023-11-19T00:41:06.281328+0000","last_clean":"2023-11-19T00:41:06.281328+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:41:06.281328+0000","last_undegraded":"2023-11-19T00:41:06.281328+0000","last_fullsized":"2023-11-19T00:41:06.281328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_clean_scrub_stamp":"2023-11-19T00:41:06.281244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:23.140955+0000","scrub_duration":0.0017497389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":240,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995676+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:41:00.995676+0000","last_peered":"2023-11-19T00:41:00.995676+0000","last_clean":"2023-11-19T00:41:00.995676+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:41:00.995676+0000","last_undegraded":"2023-11-19T00:41:00.995676+0000","last_fullsized":"2023-11-19T00:41:00.995676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995435+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:41:00.995435+0000","last_peered":"2023-11-19T00:41:00.995435+0000","last_clean":"2023-11-19T00:41:00.995435+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:41:00.995435+0000","last_undegraded":"2023-11-19T00:41:00.995435+0000","last_fullsized":"2023-11-19T00:41:00.995435+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"75'220","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.986982+0000","last_change":"2023-11-19T00:41:15.986982+0000","last_active":"2023-11-19T00:41:15.986982+0000","last_peered":"2023-11-19T00:41:15.986982+0000","last_clean":"2023-11-19T00:41:15.986982+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:41:15.986982+0000","last_undegraded":"2023-11-19T00:41:15.986982+0000","last_fullsized":"2023-11-19T00:41:15.986982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.986886+0000","objects_scrubbed":53,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:40.565603+0000","scrub_duration":0.036034849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"48'6","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629207+0000","last_change":"2023-11-19T00:40:46.731243+0000","last_active":"2023-11-19T00:40:50.629207+0000","last_peered":"2023-11-19T00:40:50.629207+0000","last_clean":"2023-11-19T00:40:50.629207+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:40:50.629207+0000","last_undegraded":"2023-11-19T00:40:50.629207+0000","last_fullsized":"2023-11-19T00:40:50.629207+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":191,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443618+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:41:01.443618+0000","last_peered":"2023-11-19T00:41:01.443618+0000","last_clean":"2023-11-19T00:41:01.443618+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:41:01.443618+0000","last_undegraded":"2023-11-19T00:41:01.443618+0000","last_fullsized":"2023-11-19T00:41:01.443618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443456+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:41:01.443456+0000","last_peered":"2023-11-19T00:41:01.443456+0000","last_clean":"2023-11-19T00:41:01.443456+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:41:01.443456+0000","last_undegraded":"2023-11-19T00:41:01.443456+0000","last_fullsized":"2023-11-19T00:41:01.443456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":214,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443590+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:41:01.443590+0000","last_peered":"2023-11-19T00:41:01.443590+0000","last_clean":"2023-11-19T00:41:01.443590+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:41:01.443590+0000","last_undegraded":"2023-11-19T00:41:01.443590+0000","last_fullsized":"2023-11-19T00:41:01.443590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":121,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995487+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:41:00.995487+0000","last_peered":"2023-11-19T00:41:00.995487+0000","last_clean":"2023-11-19T00:41:00.995487+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:41:00.995487+0000","last_undegraded":"2023-11-19T00:41:00.995487+0000","last_fullsized":"2023-11-19T00:41:00.995487+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"75'228","reported_seq":543,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.083829+0000","last_change":"2023-11-19T00:41:04.083863+0000","last_active":"2023-11-19T00:41:04.083829+0000","last_peered":"2023-11-19T00:41:04.083829+0000","last_clean":"2023-11-19T00:41:04.083829+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:41:04.083829+0000","last_undegraded":"2023-11-19T00:41:04.083829+0000","last_fullsized":"2023-11-19T00:41:04.083829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'228","last_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_deep_scrub":"75'228","last_deep_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.083754+0000","objects_scrubbed":57,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:04:56.786572+0000","scrub_duration":0.039326976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629900+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:50.629900+0000","last_peered":"2023-11-19T00:40:50.629900+0000","last_clean":"2023-11-19T00:40:50.629900+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:50.629900+0000","last_undegraded":"2023-11-19T00:40:50.629900+0000","last_fullsized":"2023-11-19T00:40:50.629900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":505,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443558+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:41:01.443558+0000","last_peered":"2023-11-19T00:41:01.443558+0000","last_clean":"2023-11-19T00:41:01.443558+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:41:01.443558+0000","last_undegraded":"2023-11-19T00:41:01.443558+0000","last_fullsized":"2023-11-19T00:41:01.443558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"75'18","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:11.205693+0000","last_change":"2023-11-19T00:41:11.205737+0000","last_active":"2023-11-19T00:41:11.205693+0000","last_peered":"2023-11-19T00:41:11.205693+0000","last_clean":"2023-11-19T00:41:11.205693+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:41:11.205693+0000","last_undegraded":"2023-11-19T00:41:11.205693+0000","last_fullsized":"2023-11-19T00:41:11.205693+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'18","last_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_deep_scrub":"75'18","last_deep_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_clean_scrub_stamp":"2023-11-19T00:41:11.205579+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:37.711995+0000","scrub_duration":0.010464658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10914,"ondisk_log_size":10914,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":438,"ondisk_log_size":438,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98992,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272848,"statfs":{"total":96636764160,"available":96535396352,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.44},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35499999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738406,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101748,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270092,"statfs":{"total":96636764160,"available":96532574208,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.56100000000000005}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.52700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738404,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113284,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258556,"statfs":{"total":96636764160,"available":96520761344,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:41:22.127 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.127 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.127 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.127 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.128 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.128 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.128 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.128 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.128 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.128 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.129 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.129 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.129 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.129 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.129 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.130 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.130 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.130 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.130 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.130 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.131 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.131 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.131 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.131 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.131 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.131 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.132 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.132 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.132 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.132 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.132 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.132 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.133 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.133 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.133 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.133 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.133 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.134 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.134 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.134 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.134 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.134 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.134 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.135 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.135 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.135 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-19T00:38:33.615993+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=33, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.135 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.135 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.136 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.136 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.136 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.136 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.136 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.137 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.137 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.137 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.138 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.138 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.138 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.139 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.139 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.139 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.139 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.140 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.140 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.140 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.140 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.140 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.140 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.141 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.141 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.141 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.141 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.141 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.141 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.142 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.142 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.142 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.142 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.142 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.143 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.143 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.143 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.143 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.143 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.144 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:22.144 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-19T00:41:42.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:41:42.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:41:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:41:42.472 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2023-11-19T00:41:41.058996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11853,"ondisk_log_size":11853,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314024,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801496,"statfs":{"total":289910292480,"available":289588731904,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003096"},"pg_stats":[{"pgid":"4.3f","version":"75'215","reported_seq":511,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.015170+0000","last_change":"2023-11-19T00:41:12.015195+0000","last_active":"2023-11-19T00:41:12.015170+0000","last_peered":"2023-11-19T00:41:12.015170+0000","last_clean":"2023-11-19T00:41:12.015170+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:41:12.015170+0000","last_undegraded":"2023-11-19T00:41:12.015170+0000","last_fullsized":"2023-11-19T00:41:12.015170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.015097+0000","objects_scrubbed":50,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:27.053797+0000","scrub_duration":0.036690850999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":226,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629517+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:50.629517+0000","last_peered":"2023-11-19T00:40:50.629517+0000","last_clean":"2023-11-19T00:40:50.629517+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:50.629517+0000","last_undegraded":"2023-11-19T00:40:50.629517+0000","last_fullsized":"2023-11-19T00:40:50.629517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828057+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:50.828057+0000","last_peered":"2023-11-19T00:40:50.828057+0000","last_clean":"2023-11-19T00:40:50.828057+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:50.828057+0000","last_undegraded":"2023-11-19T00:40:50.828057+0000","last_fullsized":"2023-11-19T00:40:50.828057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"75'172","reported_seq":232,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:10.950084+0000","last_change":"2023-11-19T00:41:10.950107+0000","last_active":"2023-11-19T00:41:10.950084+0000","last_peered":"2023-11-19T00:41:10.950084+0000","last_clean":"2023-11-19T00:41:10.950084+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:41:10.950084+0000","last_undegraded":"2023-11-19T00:41:10.950084+0000","last_fullsized":"2023-11-19T00:41:10.950084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'172","last_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_deep_scrub":"75'172","last_deep_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_clean_scrub_stamp":"2023-11-19T00:41:10.950010+0000","objects_scrubbed":51,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:03.687754+0000","scrub_duration":0.034903271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":498,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629503+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:51.629503+0000","last_peered":"2023-11-19T00:40:51.629503+0000","last_clean":"2023-11-19T00:40:51.629503+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:51.629503+0000","last_undegraded":"2023-11-19T00:40:51.629503+0000","last_fullsized":"2023-11-19T00:40:51.629503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":454,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443783+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:41:01.443783+0000","last_peered":"2023-11-19T00:41:01.443783+0000","last_clean":"2023-11-19T00:41:01.443783+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:41:01.443783+0000","last_undegraded":"2023-11-19T00:41:01.443783+0000","last_fullsized":"2023-11-19T00:41:01.443783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'165","reported_seq":218,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443735+0000","last_change":"2023-11-19T00:40:49.644399+0000","last_active":"2023-11-19T00:41:01.443735+0000","last_peered":"2023-11-19T00:41:01.443735+0000","last_clean":"2023-11-19T00:41:01.443735+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:41:01.443735+0000","last_undegraded":"2023-11-19T00:41:01.443735+0000","last_fullsized":"2023-11-19T00:41:01.443735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'131","reported_seq":369,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443719+0000","last_change":"2023-11-19T00:40:49.645985+0000","last_active":"2023-11-19T00:41:01.443719+0000","last_peered":"2023-11-19T00:41:01.443719+0000","last_clean":"2023-11-19T00:41:01.443719+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:41:01.443719+0000","last_undegraded":"2023-11-19T00:41:01.443719+0000","last_fullsized":"2023-11-19T00:41:01.443719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.238253+0000","last_change":"2023-11-19T00:41:08.238253+0000","last_active":"2023-11-19T00:41:08.238253+0000","last_peered":"2023-11-19T00:41:08.238253+0000","last_clean":"2023-11-19T00:41:08.238253+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:41:08.238253+0000","last_undegraded":"2023-11-19T00:41:08.238253+0000","last_fullsized":"2023-11-19T00:41:08.238253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.238154+0000","objects_scrubbed":51,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:28:28.657653+0000","scrub_duration":0.035756160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":412,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629401+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:50.629401+0000","last_peered":"2023-11-19T00:40:50.629401+0000","last_clean":"2023-11-19T00:40:50.629401+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:50.629401+0000","last_undegraded":"2023-11-19T00:40:50.629401+0000","last_fullsized":"2023-11-19T00:40:50.629401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"75'215","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.969246+0000","last_change":"2023-11-19T00:41:15.969271+0000","last_active":"2023-11-19T00:41:15.969246+0000","last_peered":"2023-11-19T00:41:15.969246+0000","last_clean":"2023-11-19T00:41:15.969246+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:41:15.969246+0000","last_undegraded":"2023-11-19T00:41:15.969246+0000","last_fullsized":"2023-11-19T00:41:15.969246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.969180+0000","objects_scrubbed":56,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:37:03.160511+0000","scrub_duration":0.046149739000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995814+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:41:00.995814+0000","last_peered":"2023-11-19T00:41:00.995814+0000","last_clean":"2023-11-19T00:41:00.995814+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:41:00.995814+0000","last_undegraded":"2023-11-19T00:41:00.995814+0000","last_fullsized":"2023-11-19T00:41:00.995814+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"75'183","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:09.037090+0000","last_change":"2023-11-19T00:41:09.037113+0000","last_active":"2023-11-19T00:41:09.037090+0000","last_peered":"2023-11-19T00:41:09.037090+0000","last_clean":"2023-11-19T00:41:09.037090+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:41:09.037090+0000","last_undegraded":"2023-11-19T00:41:09.037090+0000","last_fullsized":"2023-11-19T00:41:09.037090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'183","last_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_deep_scrub":"75'183","last_deep_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_clean_scrub_stamp":"2023-11-19T00:41:09.037014+0000","objects_scrubbed":50,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:26.814001+0000","scrub_duration":0.033302804999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"59'180","reported_seq":671,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443757+0000","last_change":"2023-11-19T00:40:49.638969+0000","last_active":"2023-11-19T00:41:01.443757+0000","last_peered":"2023-11-19T00:41:01.443757+0000","last_clean":"2023-11-19T00:41:01.443757+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:41:01.443757+0000","last_undegraded":"2023-11-19T00:41:01.443757+0000","last_fullsized":"2023-11-19T00:41:01.443757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":229,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443708+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:41:01.443708+0000","last_peered":"2023-11-19T00:41:01.443708+0000","last_clean":"2023-11-19T00:41:01.443708+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:41:01.443708+0000","last_undegraded":"2023-11-19T00:41:01.443708+0000","last_fullsized":"2023-11-19T00:41:01.443708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'173","reported_seq":230,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443677+0000","last_change":"2023-11-19T00:40:49.646263+0000","last_active":"2023-11-19T00:41:01.443677+0000","last_peered":"2023-11-19T00:41:01.443677+0000","last_clean":"2023-11-19T00:41:01.443677+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:41:01.443677+0000","last_undegraded":"2023-11-19T00:41:01.443677+0000","last_fullsized":"2023-11-19T00:41:01.443677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'154","reported_seq":223,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546127+0000","last_change":"2023-11-19T00:38:44.770962+0000","last_active":"2023-11-19T00:41:00.546127+0000","last_peered":"2023-11-19T00:41:00.546127+0000","last_clean":"2023-11-19T00:41:00.546127+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:41:00.546127+0000","last_undegraded":"2023-11-19T00:41:00.546127+0000","last_fullsized":"2023-11-19T00:41:00.546127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"75'199","reported_seq":483,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.090823+0000","last_change":"2023-11-19T00:41:03.090862+0000","last_active":"2023-11-19T00:41:03.090823+0000","last_peered":"2023-11-19T00:41:03.090823+0000","last_clean":"2023-11-19T00:41:03.090823+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:41:03.090823+0000","last_undegraded":"2023-11-19T00:41:03.090823+0000","last_fullsized":"2023-11-19T00:41:03.090823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.090716+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:42.528537+0000","scrub_duration":0.045074112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":417,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629306+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:50.629306+0000","last_peered":"2023-11-19T00:40:50.629306+0000","last_clean":"2023-11-19T00:40:50.629306+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:50.629306+0000","last_undegraded":"2023-11-19T00:40:50.629306+0000","last_fullsized":"2023-11-19T00:40:50.629306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"75'221","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.963592+0000","last_change":"2023-11-19T00:41:04.963623+0000","last_active":"2023-11-19T00:41:04.963592+0000","last_peered":"2023-11-19T00:41:04.963592+0000","last_clean":"2023-11-19T00:41:04.963592+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:41:04.963592+0000","last_undegraded":"2023-11-19T00:41:04.963592+0000","last_fullsized":"2023-11-19T00:41:04.963592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.963516+0000","objects_scrubbed":56,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:06.799626+0000","scrub_duration":0.039865746000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"75'217","reported_seq":275,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.942577+0000","last_change":"2023-11-19T00:41:12.942606+0000","last_active":"2023-11-19T00:41:12.942577+0000","last_peered":"2023-11-19T00:41:12.942577+0000","last_clean":"2023-11-19T00:41:12.942577+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:41:12.942577+0000","last_undegraded":"2023-11-19T00:41:12.942577+0000","last_fullsized":"2023-11-19T00:41:12.942577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'217","last_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_deep_scrub":"75'217","last_deep_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.942504+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:29.802215+0000","scrub_duration":0.042793523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":235,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995776+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:41:00.995776+0000","last_peered":"2023-11-19T00:41:00.995776+0000","last_clean":"2023-11-19T00:41:00.995776+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:41:00.995776+0000","last_undegraded":"2023-11-19T00:41:00.995776+0000","last_fullsized":"2023-11-19T00:41:00.995776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"59'151","reported_seq":220,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546042+0000","last_change":"2023-11-19T00:38:44.777744+0000","last_active":"2023-11-19T00:41:00.546042+0000","last_peered":"2023-11-19T00:41:00.546042+0000","last_clean":"2023-11-19T00:41:00.546042+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:41:00.546042+0000","last_undegraded":"2023-11-19T00:41:00.546042+0000","last_fullsized":"2023-11-19T00:41:00.546042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":218,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630031+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:56.630031+0000","last_peered":"2023-11-19T00:40:56.630031+0000","last_clean":"2023-11-19T00:40:56.630031+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:56.630031+0000","last_undegraded":"2023-11-19T00:40:56.630031+0000","last_fullsized":"2023-11-19T00:40:56.630031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"75'213","reported_seq":312,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.956972+0000","last_change":"2023-11-19T00:41:26.957022+0000","last_active":"2023-11-19T00:41:26.956972+0000","last_peered":"2023-11-19T00:41:26.956972+0000","last_clean":"2023-11-19T00:41:26.956972+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:41:26.956972+0000","last_undegraded":"2023-11-19T00:41:26.956972+0000","last_fullsized":"2023-11-19T00:41:26.956972+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.956876+0000","objects_scrubbed":53,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:31:00.258795+0000","scrub_duration":0.041573285000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"75'246","reported_seq":325,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:30.252873+0000","last_change":"2023-11-19T00:41:30.252904+0000","last_active":"2023-11-19T00:41:30.252873+0000","last_peered":"2023-11-19T00:41:30.252873+0000","last_clean":"2023-11-19T00:41:30.252873+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:41:30.252873+0000","last_undegraded":"2023-11-19T00:41:30.252873+0000","last_fullsized":"2023-11-19T00:41:30.252873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'246","last_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_deep_scrub":"75'246","last_deep_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_clean_scrub_stamp":"2023-11-19T00:41:30.252803+0000","objects_scrubbed":61,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:05:30.610485+0000","scrub_duration":0.045754178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":221,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632476+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:56.632476+0000","last_peered":"2023-11-19T00:40:56.632476+0000","last_clean":"2023-11-19T00:40:56.632476+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:56.632476+0000","last_undegraded":"2023-11-19T00:40:56.632476+0000","last_fullsized":"2023-11-19T00:40:56.632476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"75'195","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:14.991821+0000","last_change":"2023-11-19T00:41:14.991861+0000","last_active":"2023-11-19T00:41:14.991821+0000","last_peered":"2023-11-19T00:41:14.991821+0000","last_clean":"2023-11-19T00:41:14.991821+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:41:14.991821+0000","last_undegraded":"2023-11-19T00:41:14.991821+0000","last_fullsized":"2023-11-19T00:41:14.991821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'195","last_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_deep_scrub":"75'195","last_deep_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_clean_scrub_stamp":"2023-11-19T00:41:14.991747+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:33.385240+0000","scrub_duration":0.031971732000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":669,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633329+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:53.633329+0000","last_peered":"2023-11-19T00:40:53.633329+0000","last_clean":"2023-11-19T00:40:53.633329+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:53.633329+0000","last_undegraded":"2023-11-19T00:40:53.633329+0000","last_fullsized":"2023-11-19T00:40:53.633329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":268,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629483+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:51.629483+0000","last_peered":"2023-11-19T00:40:51.629483+0000","last_clean":"2023-11-19T00:40:51.629483+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:51.629483+0000","last_undegraded":"2023-11-19T00:40:51.629483+0000","last_fullsized":"2023-11-19T00:40:51.629483+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633231+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:53.633231+0000","last_peered":"2023-11-19T00:40:53.633231+0000","last_clean":"2023-11-19T00:40:53.633231+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:53.633231+0000","last_undegraded":"2023-11-19T00:40:53.633231+0000","last_fullsized":"2023-11-19T00:40:53.633231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"59'184","reported_seq":233,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827418+0000","last_change":"2023-11-19T00:40:49.646101+0000","last_active":"2023-11-19T00:40:50.827418+0000","last_peered":"2023-11-19T00:40:50.827418+0000","last_clean":"2023-11-19T00:40:50.827418+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:40:50.827418+0000","last_undegraded":"2023-11-19T00:40:50.827418+0000","last_fullsized":"2023-11-19T00:40:50.827418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":404,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629535+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:51.629535+0000","last_peered":"2023-11-19T00:40:51.629535+0000","last_clean":"2023-11-19T00:40:51.629535+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:51.629535+0000","last_undegraded":"2023-11-19T00:40:51.629535+0000","last_fullsized":"2023-11-19T00:40:51.629535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'140","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.861697+0000","last_change":"2023-11-19T00:41:08.861726+0000","last_active":"2023-11-19T00:41:08.861697+0000","last_peered":"2023-11-19T00:41:08.861697+0000","last_clean":"2023-11-19T00:41:08.861697+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:41:08.861697+0000","last_undegraded":"2023-11-19T00:41:08.861697+0000","last_fullsized":"2023-11-19T00:41:08.861697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'140","last_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_deep_scrub":"75'140","last_deep_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.861626+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:02.346222+0000","scrub_duration":0.0096612360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":473,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629510+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:50.629510+0000","last_peered":"2023-11-19T00:40:50.629510+0000","last_clean":"2023-11-19T00:40:50.629510+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:50.629510+0000","last_undegraded":"2023-11-19T00:40:50.629510+0000","last_fullsized":"2023-11-19T00:40:50.629510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545690+0000","last_change":"2023-11-19T00:38:43.774258+0000","last_active":"2023-11-19T00:41:00.545690+0000","last_peered":"2023-11-19T00:41:00.545690+0000","last_clean":"2023-11-19T00:41:00.545690+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:41:00.545690+0000","last_undegraded":"2023-11-19T00:41:00.545690+0000","last_fullsized":"2023-11-19T00:41:00.545690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'173","reported_seq":242,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545982+0000","last_change":"2023-11-19T00:38:44.772863+0000","last_active":"2023-11-19T00:41:00.545982+0000","last_peered":"2023-11-19T00:41:00.545982+0000","last_clean":"2023-11-19T00:41:00.545982+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:41:00.545982+0000","last_undegraded":"2023-11-19T00:41:00.545982+0000","last_fullsized":"2023-11-19T00:41:00.545982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995393+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:41:00.995393+0000","last_peered":"2023-11-19T00:41:00.995393+0000","last_clean":"2023-11-19T00:41:00.995393+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:41:00.995393+0000","last_undegraded":"2023-11-19T00:41:00.995393+0000","last_fullsized":"2023-11-19T00:41:00.995393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"59'152","reported_seq":210,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629528+0000","last_change":"2023-11-19T00:40:47.627223+0000","last_active":"2023-11-19T00:40:50.629528+0000","last_peered":"2023-11-19T00:40:50.629528+0000","last_clean":"2023-11-19T00:40:50.629528+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:40:50.629528+0000","last_undegraded":"2023-11-19T00:40:50.629528+0000","last_fullsized":"2023-11-19T00:40:50.629528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"75'12","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:17.957067+0000","last_change":"2023-11-19T00:41:17.957098+0000","last_active":"2023-11-19T00:41:17.957067+0000","last_peered":"2023-11-19T00:41:17.957067+0000","last_clean":"2023-11-19T00:41:17.957067+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:41:17.957067+0000","last_undegraded":"2023-11-19T00:41:17.957067+0000","last_fullsized":"2023-11-19T00:41:17.957067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_clean_scrub_stamp":"2023-11-19T00:41:17.956986+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:03:50.209311+0000","scrub_duration":0.0041360729999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443351+0000","last_change":"2023-11-19T00:40:49.637214+0000","last_active":"2023-11-19T00:41:01.443351+0000","last_peered":"2023-11-19T00:41:01.443351+0000","last_clean":"2023-11-19T00:41:01.443351+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:41:01.443351+0000","last_undegraded":"2023-11-19T00:41:01.443351+0000","last_fullsized":"2023-11-19T00:41:01.443351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":238,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630043+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:56.630043+0000","last_peered":"2023-11-19T00:40:56.630043+0000","last_clean":"2023-11-19T00:40:56.630043+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:56.630043+0000","last_undegraded":"2023-11-19T00:40:56.630043+0000","last_fullsized":"2023-11-19T00:40:56.630043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995362+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:41:00.995362+0000","last_peered":"2023-11-19T00:41:00.995362+0000","last_clean":"2023-11-19T00:41:00.995362+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:41:00.995362+0000","last_undegraded":"2023-11-19T00:41:00.995362+0000","last_fullsized":"2023-11-19T00:41:00.995362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"60'167","reported_seq":472,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628607+0000","last_change":"2023-11-19T00:40:47.640242+0000","last_active":"2023-11-19T00:40:50.628607+0000","last_peered":"2023-11-19T00:40:50.628607+0000","last_clean":"2023-11-19T00:40:50.628607+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:40:50.628607+0000","last_undegraded":"2023-11-19T00:40:50.628607+0000","last_fullsized":"2023-11-19T00:40:50.628607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443334+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:41:01.443334+0000","last_peered":"2023-11-19T00:41:01.443334+0000","last_clean":"2023-11-19T00:41:01.443334+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:41:01.443334+0000","last_undegraded":"2023-11-19T00:41:01.443334+0000","last_fullsized":"2023-11-19T00:41:01.443334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"75'201","reported_seq":481,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.932131+0000","last_change":"2023-11-19T00:41:07.932168+0000","last_active":"2023-11-19T00:41:07.932131+0000","last_peered":"2023-11-19T00:41:07.932131+0000","last_clean":"2023-11-19T00:41:07.932131+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:41:07.932131+0000","last_undegraded":"2023-11-19T00:41:07.932131+0000","last_fullsized":"2023-11-19T00:41:07.932131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'201","last_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_deep_scrub":"75'201","last_deep_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.932043+0000","objects_scrubbed":56,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:52:53.830915+0000","scrub_duration":0.040909213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443304+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:41:01.443304+0000","last_peered":"2023-11-19T00:41:01.443304+0000","last_clean":"2023-11-19T00:41:01.443304+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:41:01.443304+0000","last_undegraded":"2023-11-19T00:41:01.443304+0000","last_fullsized":"2023-11-19T00:41:01.443304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":229,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545938+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:41:00.545938+0000","last_peered":"2023-11-19T00:41:00.545938+0000","last_clean":"2023-11-19T00:41:00.545938+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:41:00.545938+0000","last_undegraded":"2023-11-19T00:41:00.545938+0000","last_fullsized":"2023-11-19T00:41:00.545938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"75'24","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.195410+0000","last_change":"2023-11-19T00:41:26.195438+0000","last_active":"2023-11-19T00:41:26.195410+0000","last_peered":"2023-11-19T00:41:26.195410+0000","last_clean":"2023-11-19T00:41:26.195410+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:41:26.195410+0000","last_undegraded":"2023-11-19T00:41:26.195410+0000","last_fullsized":"2023-11-19T00:41:26.195410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'24","last_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_deep_scrub":"75'24","last_deep_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.195316+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:42.215791+0000","scrub_duration":0.010042868999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"75'237","reported_seq":550,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:31.880355+0000","last_change":"2023-11-19T00:41:31.880416+0000","last_active":"2023-11-19T00:41:31.880355+0000","last_peered":"2023-11-19T00:41:31.880355+0000","last_clean":"2023-11-19T00:41:31.880355+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:41:31.880355+0000","last_undegraded":"2023-11-19T00:41:31.880355+0000","last_fullsized":"2023-11-19T00:41:31.880355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'237","last_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_deep_scrub":"75'237","last_deep_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_clean_scrub_stamp":"2023-11-19T00:41:31.880270+0000","objects_scrubbed":63,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:45:07.860358+0000","scrub_duration":0.045259584999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632301+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:56.632301+0000","last_peered":"2023-11-19T00:40:56.632301+0000","last_clean":"2023-11-19T00:40:56.632301+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:56.632301+0000","last_undegraded":"2023-11-19T00:40:56.632301+0000","last_fullsized":"2023-11-19T00:40:56.632301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":233,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443523+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:41:01.443523+0000","last_peered":"2023-11-19T00:41:01.443523+0000","last_clean":"2023-11-19T00:41:01.443523+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:41:01.443523+0000","last_undegraded":"2023-11-19T00:41:01.443523+0000","last_fullsized":"2023-11-19T00:41:01.443523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630074+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:56.630074+0000","last_peered":"2023-11-19T00:40:56.630074+0000","last_clean":"2023-11-19T00:40:56.630074+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:56.630074+0000","last_undegraded":"2023-11-19T00:40:56.630074+0000","last_fullsized":"2023-11-19T00:40:56.630074+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"59'137","reported_seq":574,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443494+0000","last_change":"2023-11-19T00:40:49.636684+0000","last_active":"2023-11-19T00:41:01.443494+0000","last_peered":"2023-11-19T00:41:01.443494+0000","last_clean":"2023-11-19T00:41:01.443494+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:41:01.443494+0000","last_undegraded":"2023-11-19T00:41:01.443494+0000","last_fullsized":"2023-11-19T00:41:01.443494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628665+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:50.628665+0000","last_peered":"2023-11-19T00:40:50.628665+0000","last_clean":"2023-11-19T00:40:50.628665+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:50.628665+0000","last_undegraded":"2023-11-19T00:40:50.628665+0000","last_fullsized":"2023-11-19T00:40:50.628665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"75'193","reported_seq":272,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.356161+0000","last_change":"2023-11-19T00:41:36.356189+0000","last_active":"2023-11-19T00:41:36.356161+0000","last_peered":"2023-11-19T00:41:36.356161+0000","last_clean":"2023-11-19T00:41:36.356161+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:41:36.356161+0000","last_undegraded":"2023-11-19T00:41:36.356161+0000","last_fullsized":"2023-11-19T00:41:36.356161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'193","last_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_deep_scrub":"75'193","last_deep_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.356083+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:24.448748+0000","scrub_duration":0.035468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":307,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827812+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:50.827812+0000","last_peered":"2023-11-19T00:40:50.827812+0000","last_clean":"2023-11-19T00:40:50.827812+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:50.827812+0000","last_undegraded":"2023-11-19T00:40:50.827812+0000","last_fullsized":"2023-11-19T00:40:50.827812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828182+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:50.828182+0000","last_peered":"2023-11-19T00:40:50.828182+0000","last_clean":"2023-11-19T00:40:50.828182+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:50.828182+0000","last_undegraded":"2023-11-19T00:40:50.828182+0000","last_fullsized":"2023-11-19T00:40:50.828182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443252+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:41:01.443252+0000","last_peered":"2023-11-19T00:41:01.443252+0000","last_clean":"2023-11-19T00:41:01.443252+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:41:01.443252+0000","last_undegraded":"2023-11-19T00:41:01.443252+0000","last_fullsized":"2023-11-19T00:41:01.443252+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":428,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631701+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:51.631701+0000","last_peered":"2023-11-19T00:40:51.631701+0000","last_clean":"2023-11-19T00:40:51.631701+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:51.631701+0000","last_undegraded":"2023-11-19T00:40:51.631701+0000","last_fullsized":"2023-11-19T00:40:51.631701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827672+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:50.827672+0000","last_peered":"2023-11-19T00:40:50.827672+0000","last_clean":"2023-11-19T00:40:50.827672+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:50.827672+0000","last_undegraded":"2023-11-19T00:40:50.827672+0000","last_fullsized":"2023-11-19T00:40:50.827672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'34","reported_seq":137,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629070+0000","last_change":"2023-11-19T00:38:43.772322+0000","last_active":"2023-11-19T00:40:50.629070+0000","last_peered":"2023-11-19T00:40:50.629070+0000","last_clean":"2023-11-19T00:40:50.629070+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:40:50.629070+0000","last_undegraded":"2023-11-19T00:40:50.629070+0000","last_fullsized":"2023-11-19T00:40:50.629070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"75'208","reported_seq":718,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.122122+0000","last_change":"2023-11-19T00:41:07.122147+0000","last_active":"2023-11-19T00:41:07.122122+0000","last_peered":"2023-11-19T00:41:07.122122+0000","last_clean":"2023-11-19T00:41:07.122122+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:41:07.122122+0000","last_undegraded":"2023-11-19T00:41:07.122122+0000","last_fullsized":"2023-11-19T00:41:07.122122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'208","last_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_deep_scrub":"75'208","last_deep_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.122048+0000","objects_scrubbed":53,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:15.227402+0000","scrub_duration":0.037815080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629202+0000","last_change":"2023-11-19T00:38:39.744406+0000","last_active":"2023-11-19T00:40:50.629202+0000","last_peered":"2023-11-19T00:40:50.629202+0000","last_clean":"2023-11-19T00:40:50.629202+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:40:50.629202+0000","last_undegraded":"2023-11-19T00:40:50.629202+0000","last_fullsized":"2023-11-19T00:40:50.629202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"75'60","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.966230+0000","last_change":"2023-11-19T00:41:35.966258+0000","last_active":"2023-11-19T00:41:35.966230+0000","last_peered":"2023-11-19T00:41:35.966230+0000","last_clean":"2023-11-19T00:41:35.966230+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:41:35.966230+0000","last_undegraded":"2023-11-19T00:41:35.966230+0000","last_fullsized":"2023-11-19T00:41:35.966230+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.966137+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:39.525924+0000","scrub_duration":0.010289223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":680,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:58.634147+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:58.634147+0000","last_peered":"2023-11-19T00:40:58.634147+0000","last_clean":"2023-11-19T00:40:58.634147+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:58.634147+0000","last_undegraded":"2023-11-19T00:40:58.634147+0000","last_fullsized":"2023-11-19T00:40:58.634147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828389+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:50.828389+0000","last_peered":"2023-11-19T00:40:50.828389+0000","last_clean":"2023-11-19T00:40:50.828389+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:50.828389+0000","last_undegraded":"2023-11-19T00:40:50.828389+0000","last_fullsized":"2023-11-19T00:40:50.828389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631576+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:51.631576+0000","last_peered":"2023-11-19T00:40:51.631576+0000","last_clean":"2023-11-19T00:40:51.631576+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:51.631576+0000","last_undegraded":"2023-11-19T00:40:51.631576+0000","last_fullsized":"2023-11-19T00:40:51.631576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":456,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629292+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:50.629292+0000","last_peered":"2023-11-19T00:40:50.629292+0000","last_clean":"2023-11-19T00:40:50.629292+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:50.629292+0000","last_undegraded":"2023-11-19T00:40:50.629292+0000","last_fullsized":"2023-11-19T00:40:50.629292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:13.930783+0000","last_change":"2023-11-19T00:41:13.930804+0000","last_active":"2023-11-19T00:41:13.930783+0000","last_peered":"2023-11-19T00:41:13.930783+0000","last_clean":"2023-11-19T00:41:13.930783+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:41:13.930783+0000","last_undegraded":"2023-11-19T00:41:13.930783+0000","last_fullsized":"2023-11-19T00:41:13.930783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_clean_scrub_stamp":"2023-11-19T00:41:13.930701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:52.200874+0000","scrub_duration":0.001907448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.394157+0000","last_change":"2023-11-19T00:41:03.394178+0000","last_active":"2023-11-19T00:41:03.394157+0000","last_peered":"2023-11-19T00:41:03.394157+0000","last_clean":"2023-11-19T00:41:03.394157+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:41:03.394157+0000","last_undegraded":"2023-11-19T00:41:03.394157+0000","last_fullsized":"2023-11-19T00:41:03.394157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.394072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:55:33.909806+0000","scrub_duration":0.0022610909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":242,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:02.407225+0000","last_change":"2023-11-19T00:41:02.407245+0000","last_active":"2023-11-19T00:41:02.407225+0000","last_peered":"2023-11-19T00:41:02.407225+0000","last_clean":"2023-11-19T00:41:02.407225+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:41:02.407225+0000","last_undegraded":"2023-11-19T00:41:02.407225+0000","last_fullsized":"2023-11-19T00:41:02.407225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_clean_scrub_stamp":"2023-11-19T00:41:02.407143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:08:56.907868+0000","scrub_duration":0.001710039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629814+0000","last_change":"2023-11-19T00:40:47.644472+0000","last_active":"2023-11-19T00:40:50.629814+0000","last_peered":"2023-11-19T00:40:50.629814+0000","last_clean":"2023-11-19T00:40:50.629814+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:40:50.629814+0000","last_undegraded":"2023-11-19T00:40:50.629814+0000","last_fullsized":"2023-11-19T00:40:50.629814+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":250,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629525+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:51.629525+0000","last_peered":"2023-11-19T00:40:51.629525+0000","last_clean":"2023-11-19T00:40:51.629525+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:51.629525+0000","last_undegraded":"2023-11-19T00:40:51.629525+0000","last_fullsized":"2023-11-19T00:40:51.629525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633535+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:53.633535+0000","last_peered":"2023-11-19T00:40:53.633535+0000","last_clean":"2023-11-19T00:40:53.633535+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:53.633535+0000","last_undegraded":"2023-11-19T00:40:53.633535+0000","last_fullsized":"2023-11-19T00:40:53.633535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:33.306579+0000","last_change":"2023-11-19T00:41:33.306598+0000","last_active":"2023-11-19T00:41:33.306579+0000","last_peered":"2023-11-19T00:41:33.306579+0000","last_clean":"2023-11-19T00:41:33.306579+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:41:33.306579+0000","last_undegraded":"2023-11-19T00:41:33.306579+0000","last_fullsized":"2023-11-19T00:41:33.306579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_clean_scrub_stamp":"2023-11-19T00:41:33.306492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:54:35.500265+0000","scrub_duration":0.0019877990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:50.628529+0000","last_peered":"2023-11-19T00:40:50.628529+0000","last_clean":"2023-11-19T00:40:50.628529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:50.628529+0000","last_undegraded":"2023-11-19T00:40:50.628529+0000","last_fullsized":"2023-11-19T00:40:50.628529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"62'12","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629902+0000","last_change":"2023-11-19T00:40:44.753894+0000","last_active":"2023-11-19T00:40:50.629902+0000","last_peered":"2023-11-19T00:40:50.629902+0000","last_clean":"2023-11-19T00:40:50.629902+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:40:50.629902+0000","last_undegraded":"2023-11-19T00:40:50.629902+0000","last_fullsized":"2023-11-19T00:40:50.629902+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:18.983274+0000","last_change":"2023-11-19T00:41:18.983296+0000","last_active":"2023-11-19T00:41:18.983274+0000","last_peered":"2023-11-19T00:41:18.983274+0000","last_clean":"2023-11-19T00:41:18.983274+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:41:18.983274+0000","last_undegraded":"2023-11-19T00:41:18.983274+0000","last_fullsized":"2023-11-19T00:41:18.983274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_clean_scrub_stamp":"2023-11-19T00:41:18.983139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:41.254459+0000","scrub_duration":0.002267593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"75'186","reported_seq":284,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:32.952304+0000","last_change":"2023-11-19T00:41:32.952330+0000","last_active":"2023-11-19T00:41:32.952304+0000","last_peered":"2023-11-19T00:41:32.952304+0000","last_clean":"2023-11-19T00:41:32.952304+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:41:32.952304+0000","last_undegraded":"2023-11-19T00:41:32.952304+0000","last_fullsized":"2023-11-19T00:41:32.952304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_clean_scrub_stamp":"2023-11-19T00:41:32.952223+0000","objects_scrubbed":51,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:14.957145+0000","scrub_duration":0.037260673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":459,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443524+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:41:01.443524+0000","last_peered":"2023-11-19T00:41:01.443524+0000","last_clean":"2023-11-19T00:41:01.443524+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:41:01.443524+0000","last_undegraded":"2023-11-19T00:41:01.443524+0000","last_fullsized":"2023-11-19T00:41:01.443524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"75'46","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:34.879339+0000","last_change":"2023-11-19T00:41:34.879370+0000","last_active":"2023-11-19T00:41:34.879339+0000","last_peered":"2023-11-19T00:41:34.879339+0000","last_clean":"2023-11-19T00:41:34.879339+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:41:34.879339+0000","last_undegraded":"2023-11-19T00:41:34.879339+0000","last_fullsized":"2023-11-19T00:41:34.879339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_clean_scrub_stamp":"2023-11-19T00:41:34.879255+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:29.054637+0000","scrub_duration":0.011582451000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":629,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546002+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:41:00.546002+0000","last_peered":"2023-11-19T00:41:00.546002+0000","last_clean":"2023-11-19T00:41:00.546002+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:41:00.546002+0000","last_undegraded":"2023-11-19T00:41:00.546002+0000","last_fullsized":"2023-11-19T00:41:00.546002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"75'21","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.005846+0000","last_change":"2023-11-19T00:41:35.005876+0000","last_active":"2023-11-19T00:41:35.005846+0000","last_peered":"2023-11-19T00:41:35.005846+0000","last_clean":"2023-11-19T00:41:35.005846+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:41:35.005846+0000","last_undegraded":"2023-11-19T00:41:35.005846+0000","last_fullsized":"2023-11-19T00:41:35.005846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'21","last_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_deep_scrub":"75'21","last_deep_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.005745+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:31:58.190130+0000","scrub_duration":0.0037074590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443438+0000","last_change":"2023-11-19T00:40:49.646455+0000","last_active":"2023-11-19T00:41:01.443438+0000","last_peered":"2023-11-19T00:41:01.443438+0000","last_clean":"2023-11-19T00:41:01.443438+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:41:01.443438+0000","last_undegraded":"2023-11-19T00:41:01.443438+0000","last_fullsized":"2023-11-19T00:41:01.443438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":239,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545941+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:41:00.545941+0000","last_peered":"2023-11-19T00:41:00.545941+0000","last_clean":"2023-11-19T00:41:00.545941+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:41:00.545941+0000","last_undegraded":"2023-11-19T00:41:00.545941+0000","last_fullsized":"2023-11-19T00:41:00.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545741+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:41:00.545741+0000","last_peered":"2023-11-19T00:41:00.545741+0000","last_clean":"2023-11-19T00:41:00.545741+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:41:00.545741+0000","last_undegraded":"2023-11-19T00:41:00.545741+0000","last_fullsized":"2023-11-19T00:41:00.545741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":443,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628520+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:50.628520+0000","last_peered":"2023-11-19T00:40:50.628520+0000","last_clean":"2023-11-19T00:40:50.628520+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:50.628520+0000","last_undegraded":"2023-11-19T00:40:50.628520+0000","last_fullsized":"2023-11-19T00:40:50.628520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629928+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:50.629928+0000","last_peered":"2023-11-19T00:40:50.629928+0000","last_clean":"2023-11-19T00:40:50.629928+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:50.629928+0000","last_undegraded":"2023-11-19T00:40:50.629928+0000","last_fullsized":"2023-11-19T00:40:50.629928+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545752+0000","last_change":"2023-11-19T00:40:46.713850+0000","last_active":"2023-11-19T00:41:00.545752+0000","last_peered":"2023-11-19T00:41:00.545752+0000","last_clean":"2023-11-19T00:41:00.545752+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:41:00.545752+0000","last_undegraded":"2023-11-19T00:41:00.545752+0000","last_fullsized":"2023-11-19T00:41:00.545752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"75'202","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:19.306630+0000","last_change":"2023-11-19T00:41:19.306669+0000","last_active":"2023-11-19T00:41:19.306630+0000","last_peered":"2023-11-19T00:41:19.306630+0000","last_clean":"2023-11-19T00:41:19.306630+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:41:19.306630+0000","last_undegraded":"2023-11-19T00:41:19.306630+0000","last_fullsized":"2023-11-19T00:41:19.306630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'202","last_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_deep_scrub":"75'202","last_deep_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:19.306536+0000","objects_scrubbed":49,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:17.124610+0000","scrub_duration":0.034907383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:06.281328+0000","last_change":"2023-11-19T00:41:06.281350+0000","last_active":"2023-11-19T00:41:06.281328+0000","last_peered":"2023-11-19T00:41:06.281328+0000","last_clean":"2023-11-19T00:41:06.281328+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:41:06.281328+0000","last_undegraded":"2023-11-19T00:41:06.281328+0000","last_fullsized":"2023-11-19T00:41:06.281328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_clean_scrub_stamp":"2023-11-19T00:41:06.281244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:23.140955+0000","scrub_duration":0.0017497389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":240,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995676+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:41:00.995676+0000","last_peered":"2023-11-19T00:41:00.995676+0000","last_clean":"2023-11-19T00:41:00.995676+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:41:00.995676+0000","last_undegraded":"2023-11-19T00:41:00.995676+0000","last_fullsized":"2023-11-19T00:41:00.995676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995435+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:41:00.995435+0000","last_peered":"2023-11-19T00:41:00.995435+0000","last_clean":"2023-11-19T00:41:00.995435+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:41:00.995435+0000","last_undegraded":"2023-11-19T00:41:00.995435+0000","last_fullsized":"2023-11-19T00:41:00.995435+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"75'220","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.986982+0000","last_change":"2023-11-19T00:41:15.986982+0000","last_active":"2023-11-19T00:41:15.986982+0000","last_peered":"2023-11-19T00:41:15.986982+0000","last_clean":"2023-11-19T00:41:15.986982+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:41:15.986982+0000","last_undegraded":"2023-11-19T00:41:15.986982+0000","last_fullsized":"2023-11-19T00:41:15.986982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.986886+0000","objects_scrubbed":53,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:40.565603+0000","scrub_duration":0.036034849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"75'7","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:29.949945+0000","last_change":"2023-11-19T00:41:29.949973+0000","last_active":"2023-11-19T00:41:29.949945+0000","last_peered":"2023-11-19T00:41:29.949945+0000","last_clean":"2023-11-19T00:41:29.949945+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:41:29.949945+0000","last_undegraded":"2023-11-19T00:41:29.949945+0000","last_fullsized":"2023-11-19T00:41:29.949945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'7","last_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_deep_scrub":"75'7","last_deep_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_clean_scrub_stamp":"2023-11-19T00:41:29.949858+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:16:37.535582+0000","scrub_duration":0.009494878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":191,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443618+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:41:01.443618+0000","last_peered":"2023-11-19T00:41:01.443618+0000","last_clean":"2023-11-19T00:41:01.443618+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:41:01.443618+0000","last_undegraded":"2023-11-19T00:41:01.443618+0000","last_fullsized":"2023-11-19T00:41:01.443618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443456+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:41:01.443456+0000","last_peered":"2023-11-19T00:41:01.443456+0000","last_clean":"2023-11-19T00:41:01.443456+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:41:01.443456+0000","last_undegraded":"2023-11-19T00:41:01.443456+0000","last_fullsized":"2023-11-19T00:41:01.443456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":214,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443590+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:41:01.443590+0000","last_peered":"2023-11-19T00:41:01.443590+0000","last_clean":"2023-11-19T00:41:01.443590+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:41:01.443590+0000","last_undegraded":"2023-11-19T00:41:01.443590+0000","last_fullsized":"2023-11-19T00:41:01.443590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"45'53","reported_seq":121,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995487+0000","last_change":"2023-11-19T00:40:25.677147+0000","last_active":"2023-11-19T00:41:00.995487+0000","last_peered":"2023-11-19T00:41:00.995487+0000","last_clean":"2023-11-19T00:41:00.995487+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:41:00.995487+0000","last_undegraded":"2023-11-19T00:41:00.995487+0000","last_fullsized":"2023-11-19T00:41:00.995487+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"75'228","reported_seq":543,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.083829+0000","last_change":"2023-11-19T00:41:04.083863+0000","last_active":"2023-11-19T00:41:04.083829+0000","last_peered":"2023-11-19T00:41:04.083829+0000","last_clean":"2023-11-19T00:41:04.083829+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:41:04.083829+0000","last_undegraded":"2023-11-19T00:41:04.083829+0000","last_fullsized":"2023-11-19T00:41:04.083829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'228","last_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_deep_scrub":"75'228","last_deep_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.083754+0000","objects_scrubbed":57,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:04:56.786572+0000","scrub_duration":0.039326976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629900+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:50.629900+0000","last_peered":"2023-11-19T00:40:50.629900+0000","last_clean":"2023-11-19T00:40:50.629900+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:50.629900+0000","last_undegraded":"2023-11-19T00:40:50.629900+0000","last_fullsized":"2023-11-19T00:40:50.629900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"59'190","reported_seq":505,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443558+0000","last_change":"2023-11-19T00:40:49.645671+0000","last_active":"2023-11-19T00:41:01.443558+0000","last_peered":"2023-11-19T00:41:01.443558+0000","last_clean":"2023-11-19T00:41:01.443558+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:41:01.443558+0000","last_undegraded":"2023-11-19T00:41:01.443558+0000","last_fullsized":"2023-11-19T00:41:01.443558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"75'18","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:11.205693+0000","last_change":"2023-11-19T00:41:11.205737+0000","last_active":"2023-11-19T00:41:11.205693+0000","last_peered":"2023-11-19T00:41:11.205693+0000","last_clean":"2023-11-19T00:41:11.205693+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:41:11.205693+0000","last_undegraded":"2023-11-19T00:41:11.205693+0000","last_fullsized":"2023-11-19T00:41:11.205693+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'18","last_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_deep_scrub":"75'18","last_deep_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_clean_scrub_stamp":"2023-11-19T00:41:11.205579+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:37.711995+0000","scrub_duration":0.010464658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11244,"ondisk_log_size":11244,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":452,"ondisk_log_size":452,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98992,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94272848,"statfs":{"total":96636764160,"available":96535396352,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.48699999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60299999999999998,"5min":0.625,"15min":0.625},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Nov 19 00:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.52700000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738410,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101748,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94270092,"statfs":{"total":96636764160,"available":96532574208,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58299999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48399999999999999}]},{"osd":1,"last update":"Sun Nov 19 00:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57999999999999996,"5min":0.63,"15min":0.63},"last":0.503},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.52300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738408,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113284,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258556,"statfs":{"total":96636764160,"available":96520761344,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55700000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.37},{"interface":"front","average":{"1min":0.372,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51900000000000002,"5min":0.625,"15min":0.625},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Nov 19 00:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.438,"15min":0.443},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:41:42.479 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.479 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.480 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.480 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.480 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.481 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.482 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.482 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.482 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.482 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.482 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.483 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.483 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.483 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.483 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.484 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.484 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.484 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.484 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.484 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.485 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.485 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.485 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.485 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.485 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.486 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.486 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.486 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.486 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.486 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.487 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.487 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.487 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.487 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.487 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.488 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.488 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.488 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.488 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.488 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-19T00:38:33.615993+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=33, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.489 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.489 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.489 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.489 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.489 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.489 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.490 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.490 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.490 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.490 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.491 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.491 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.491 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.491 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.491 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.492 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.492 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.492 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.492 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.492 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.493 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.493 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.493 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.493 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.493 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.494 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.494 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.494 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.494 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.494 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.495 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.495 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:41:42.495 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-19T00:42:02.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:42:02.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:42:02.813 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:42:02.823 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-11-19T00:42:01.064471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12522,"ondisk_log_size":12522,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":322344,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":168443,"kb_avail":282793176,"statfs":{"total":289910292480,"available":289580212224,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":172485967},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003194"},"pg_stats":[{"pgid":"4.3f","version":"75'215","reported_seq":511,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.015170+0000","last_change":"2023-11-19T00:41:12.015195+0000","last_active":"2023-11-19T00:41:12.015170+0000","last_peered":"2023-11-19T00:41:12.015170+0000","last_clean":"2023-11-19T00:41:12.015170+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:41:12.015170+0000","last_undegraded":"2023-11-19T00:41:12.015170+0000","last_fullsized":"2023-11-19T00:41:12.015170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.015097+0000","objects_scrubbed":50,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:27.053797+0000","scrub_duration":0.036690850999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"59'162","reported_seq":226,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629517+0000","last_change":"2023-11-19T00:40:47.641440+0000","last_active":"2023-11-19T00:40:50.629517+0000","last_peered":"2023-11-19T00:40:50.629517+0000","last_clean":"2023-11-19T00:40:50.629517+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:40:50.629517+0000","last_undegraded":"2023-11-19T00:40:50.629517+0000","last_fullsized":"2023-11-19T00:40:50.629517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"59'168","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828057+0000","last_change":"2023-11-19T00:40:49.640139+0000","last_active":"2023-11-19T00:40:50.828057+0000","last_peered":"2023-11-19T00:40:50.828057+0000","last_clean":"2023-11-19T00:40:50.828057+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:40:50.828057+0000","last_undegraded":"2023-11-19T00:40:50.828057+0000","last_fullsized":"2023-11-19T00:40:50.828057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"75'172","reported_seq":232,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:10.950084+0000","last_change":"2023-11-19T00:41:10.950107+0000","last_active":"2023-11-19T00:41:10.950084+0000","last_peered":"2023-11-19T00:41:10.950084+0000","last_clean":"2023-11-19T00:41:10.950084+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:41:10.950084+0000","last_undegraded":"2023-11-19T00:41:10.950084+0000","last_fullsized":"2023-11-19T00:41:10.950084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'172","last_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_deep_scrub":"75'172","last_deep_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_clean_scrub_stamp":"2023-11-19T00:41:10.950010+0000","objects_scrubbed":51,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:03.687754+0000","scrub_duration":0.034903271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":498,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629503+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:51.629503+0000","last_peered":"2023-11-19T00:40:51.629503+0000","last_clean":"2023-11-19T00:40:51.629503+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:51.629503+0000","last_undegraded":"2023-11-19T00:40:51.629503+0000","last_fullsized":"2023-11-19T00:40:51.629503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":454,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443783+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:41:01.443783+0000","last_peered":"2023-11-19T00:41:01.443783+0000","last_clean":"2023-11-19T00:41:01.443783+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:41:01.443783+0000","last_undegraded":"2023-11-19T00:41:01.443783+0000","last_fullsized":"2023-11-19T00:41:01.443783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"75'227","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:41.910516+0000","last_change":"2023-11-19T00:41:41.910554+0000","last_active":"2023-11-19T00:41:41.910516+0000","last_peered":"2023-11-19T00:41:41.910516+0000","last_clean":"2023-11-19T00:41:41.910516+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:41:41.910516+0000","last_undegraded":"2023-11-19T00:41:41.910516+0000","last_fullsized":"2023-11-19T00:41:41.910516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'227","last_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_deep_scrub":"75'227","last_deep_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_clean_scrub_stamp":"2023-11-19T00:41:41.910446+0000","objects_scrubbed":62,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:52.519112+0000","scrub_duration":0.043757361000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"75'179","reported_seq":426,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.949857+0000","last_change":"2023-11-19T00:41:36.949897+0000","last_active":"2023-11-19T00:41:36.949857+0000","last_peered":"2023-11-19T00:41:36.949857+0000","last_clean":"2023-11-19T00:41:36.949857+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:41:36.949857+0000","last_undegraded":"2023-11-19T00:41:36.949857+0000","last_fullsized":"2023-11-19T00:41:36.949857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'179","last_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_deep_scrub":"75'179","last_deep_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.949768+0000","objects_scrubbed":48,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:32.130529+0000","scrub_duration":0.033692611999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.238253+0000","last_change":"2023-11-19T00:41:08.238253+0000","last_active":"2023-11-19T00:41:08.238253+0000","last_peered":"2023-11-19T00:41:08.238253+0000","last_clean":"2023-11-19T00:41:08.238253+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:41:08.238253+0000","last_undegraded":"2023-11-19T00:41:08.238253+0000","last_fullsized":"2023-11-19T00:41:08.238253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.238154+0000","objects_scrubbed":51,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:28:28.657653+0000","scrub_duration":0.035756160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":412,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629401+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:50.629401+0000","last_peered":"2023-11-19T00:40:50.629401+0000","last_clean":"2023-11-19T00:40:50.629401+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:50.629401+0000","last_undegraded":"2023-11-19T00:40:50.629401+0000","last_fullsized":"2023-11-19T00:40:50.629401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"75'215","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.969246+0000","last_change":"2023-11-19T00:41:15.969271+0000","last_active":"2023-11-19T00:41:15.969246+0000","last_peered":"2023-11-19T00:41:15.969246+0000","last_clean":"2023-11-19T00:41:15.969246+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:41:15.969246+0000","last_undegraded":"2023-11-19T00:41:15.969246+0000","last_fullsized":"2023-11-19T00:41:15.969246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.969180+0000","objects_scrubbed":56,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:37:03.160511+0000","scrub_duration":0.046149739000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'136","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995814+0000","last_change":"2023-11-19T00:40:25.679390+0000","last_active":"2023-11-19T00:41:00.995814+0000","last_peered":"2023-11-19T00:41:00.995814+0000","last_clean":"2023-11-19T00:41:00.995814+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:41:00.995814+0000","last_undegraded":"2023-11-19T00:41:00.995814+0000","last_fullsized":"2023-11-19T00:41:00.995814+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"75'183","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:09.037090+0000","last_change":"2023-11-19T00:41:09.037113+0000","last_active":"2023-11-19T00:41:09.037090+0000","last_peered":"2023-11-19T00:41:09.037090+0000","last_clean":"2023-11-19T00:41:09.037090+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:41:09.037090+0000","last_undegraded":"2023-11-19T00:41:09.037090+0000","last_fullsized":"2023-11-19T00:41:09.037090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'183","last_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_deep_scrub":"75'183","last_deep_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_clean_scrub_stamp":"2023-11-19T00:41:09.037014+0000","objects_scrubbed":50,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:26.814001+0000","scrub_duration":0.033302804999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"75'224","reported_seq":724,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:52.995941+0000","last_change":"2023-11-19T00:41:52.995980+0000","last_active":"2023-11-19T00:41:52.995941+0000","last_peered":"2023-11-19T00:41:52.995941+0000","last_clean":"2023-11-19T00:41:52.995941+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:41:52.995941+0000","last_undegraded":"2023-11-19T00:41:52.995941+0000","last_fullsized":"2023-11-19T00:41:52.995941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'224","last_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_deep_scrub":"75'224","last_deep_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_clean_scrub_stamp":"2023-11-19T00:41:52.995854+0000","objects_scrubbed":44,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:27.412450+0000","scrub_duration":0.030047951999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'156","reported_seq":229,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443708+0000","last_change":"2023-11-19T00:40:49.634087+0000","last_active":"2023-11-19T00:41:01.443708+0000","last_peered":"2023-11-19T00:41:01.443708+0000","last_clean":"2023-11-19T00:41:01.443708+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:41:01.443708+0000","last_undegraded":"2023-11-19T00:41:01.443708+0000","last_fullsized":"2023-11-19T00:41:01.443708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'231","reported_seq":298,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:51.008109+0000","last_change":"2023-11-19T00:41:51.008143+0000","last_active":"2023-11-19T00:41:51.008109+0000","last_peered":"2023-11-19T00:41:51.008109+0000","last_clean":"2023-11-19T00:41:51.008109+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:41:51.008109+0000","last_undegraded":"2023-11-19T00:41:51.008109+0000","last_fullsized":"2023-11-19T00:41:51.008109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_clean_scrub_stamp":"2023-11-19T00:41:51.008026+0000","objects_scrubbed":58,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:38.626133+0000","scrub_duration":0.041732172999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"75'207","reported_seq":286,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.461743+0000","last_change":"2023-11-19T00:41:48.461784+0000","last_active":"2023-11-19T00:41:48.461743+0000","last_peered":"2023-11-19T00:41:48.461743+0000","last_clean":"2023-11-19T00:41:48.461743+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:41:48.461743+0000","last_undegraded":"2023-11-19T00:41:48.461743+0000","last_fullsized":"2023-11-19T00:41:48.461743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.461644+0000","objects_scrubbed":53,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:30:42.739782+0000","scrub_duration":0.045335093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"75'199","reported_seq":483,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.090823+0000","last_change":"2023-11-19T00:41:03.090862+0000","last_active":"2023-11-19T00:41:03.090823+0000","last_peered":"2023-11-19T00:41:03.090823+0000","last_clean":"2023-11-19T00:41:03.090823+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:41:03.090823+0000","last_undegraded":"2023-11-19T00:41:03.090823+0000","last_fullsized":"2023-11-19T00:41:03.090823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.090716+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:42.528537+0000","scrub_duration":0.045074112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":417,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629306+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:50.629306+0000","last_peered":"2023-11-19T00:40:50.629306+0000","last_clean":"2023-11-19T00:40:50.629306+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:50.629306+0000","last_undegraded":"2023-11-19T00:40:50.629306+0000","last_fullsized":"2023-11-19T00:40:50.629306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"75'221","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.963592+0000","last_change":"2023-11-19T00:41:04.963623+0000","last_active":"2023-11-19T00:41:04.963592+0000","last_peered":"2023-11-19T00:41:04.963592+0000","last_clean":"2023-11-19T00:41:04.963592+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:41:04.963592+0000","last_undegraded":"2023-11-19T00:41:04.963592+0000","last_fullsized":"2023-11-19T00:41:04.963592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.963516+0000","objects_scrubbed":56,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:06.799626+0000","scrub_duration":0.039865746000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"75'217","reported_seq":275,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.942577+0000","last_change":"2023-11-19T00:41:12.942606+0000","last_active":"2023-11-19T00:41:12.942577+0000","last_peered":"2023-11-19T00:41:12.942577+0000","last_clean":"2023-11-19T00:41:12.942577+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:41:12.942577+0000","last_undegraded":"2023-11-19T00:41:12.942577+0000","last_fullsized":"2023-11-19T00:41:12.942577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'217","last_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_deep_scrub":"75'217","last_deep_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.942504+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:29.802215+0000","scrub_duration":0.042793523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'166","reported_seq":235,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995776+0000","last_change":"2023-11-19T00:38:44.776821+0000","last_active":"2023-11-19T00:41:00.995776+0000","last_peered":"2023-11-19T00:41:00.995776+0000","last_clean":"2023-11-19T00:41:00.995776+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:41:00.995776+0000","last_undegraded":"2023-11-19T00:41:00.995776+0000","last_fullsized":"2023-11-19T00:41:00.995776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"75'211","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.392748+0000","last_change":"2023-11-19T00:41:42.392777+0000","last_active":"2023-11-19T00:41:42.392748+0000","last_peered":"2023-11-19T00:41:42.392748+0000","last_clean":"2023-11-19T00:41:42.392748+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:41:42.392748+0000","last_undegraded":"2023-11-19T00:41:42.392748+0000","last_fullsized":"2023-11-19T00:41:42.392748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.392663+0000","objects_scrubbed":60,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:23.806495+0000","scrub_duration":0.040785126999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":218,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630031+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:56.630031+0000","last_peered":"2023-11-19T00:40:56.630031+0000","last_clean":"2023-11-19T00:40:56.630031+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:56.630031+0000","last_undegraded":"2023-11-19T00:40:56.630031+0000","last_fullsized":"2023-11-19T00:40:56.630031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"75'213","reported_seq":312,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.956972+0000","last_change":"2023-11-19T00:41:26.957022+0000","last_active":"2023-11-19T00:41:26.956972+0000","last_peered":"2023-11-19T00:41:26.956972+0000","last_clean":"2023-11-19T00:41:26.956972+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:41:26.956972+0000","last_undegraded":"2023-11-19T00:41:26.956972+0000","last_fullsized":"2023-11-19T00:41:26.956972+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.956876+0000","objects_scrubbed":53,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:31:00.258795+0000","scrub_duration":0.041573285000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"75'246","reported_seq":325,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:30.252873+0000","last_change":"2023-11-19T00:41:30.252904+0000","last_active":"2023-11-19T00:41:30.252873+0000","last_peered":"2023-11-19T00:41:30.252873+0000","last_clean":"2023-11-19T00:41:30.252873+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:41:30.252873+0000","last_undegraded":"2023-11-19T00:41:30.252873+0000","last_fullsized":"2023-11-19T00:41:30.252873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'246","last_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_deep_scrub":"75'246","last_deep_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_clean_scrub_stamp":"2023-11-19T00:41:30.252803+0000","objects_scrubbed":61,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:05:30.610485+0000","scrub_duration":0.045754178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"59'148","reported_seq":221,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632476+0000","last_change":"2023-11-19T00:40:49.639985+0000","last_active":"2023-11-19T00:40:56.632476+0000","last_peered":"2023-11-19T00:40:56.632476+0000","last_clean":"2023-11-19T00:40:56.632476+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:40:56.632476+0000","last_undegraded":"2023-11-19T00:40:56.632476+0000","last_fullsized":"2023-11-19T00:40:56.632476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"75'195","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:14.991821+0000","last_change":"2023-11-19T00:41:14.991861+0000","last_active":"2023-11-19T00:41:14.991821+0000","last_peered":"2023-11-19T00:41:14.991821+0000","last_clean":"2023-11-19T00:41:14.991821+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:41:14.991821+0000","last_undegraded":"2023-11-19T00:41:14.991821+0000","last_fullsized":"2023-11-19T00:41:14.991821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'195","last_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_deep_scrub":"75'195","last_deep_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_clean_scrub_stamp":"2023-11-19T00:41:14.991747+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:33.385240+0000","scrub_duration":0.031971732000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":669,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633329+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:53.633329+0000","last_peered":"2023-11-19T00:40:53.633329+0000","last_clean":"2023-11-19T00:40:53.633329+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:53.633329+0000","last_undegraded":"2023-11-19T00:40:53.633329+0000","last_fullsized":"2023-11-19T00:40:53.633329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":268,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629483+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:51.629483+0000","last_peered":"2023-11-19T00:40:51.629483+0000","last_clean":"2023-11-19T00:40:51.629483+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:51.629483+0000","last_undegraded":"2023-11-19T00:40:51.629483+0000","last_fullsized":"2023-11-19T00:40:51.629483+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633231+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:53.633231+0000","last_peered":"2023-11-19T00:40:53.633231+0000","last_clean":"2023-11-19T00:40:53.633231+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:53.633231+0000","last_undegraded":"2023-11-19T00:40:53.633231+0000","last_fullsized":"2023-11-19T00:40:53.633231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"75'234","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.033187+0000","last_change":"2023-11-19T00:41:55.033234+0000","last_active":"2023-11-19T00:41:55.033187+0000","last_peered":"2023-11-19T00:41:55.033187+0000","last_clean":"2023-11-19T00:41:55.033187+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:41:55.033187+0000","last_undegraded":"2023-11-19T00:41:55.033187+0000","last_fullsized":"2023-11-19T00:41:55.033187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'234","last_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_deep_scrub":"75'234","last_deep_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.033097+0000","objects_scrubbed":50,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:01.427989+0000","scrub_duration":0.036056435999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":404,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629535+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:51.629535+0000","last_peered":"2023-11-19T00:40:51.629535+0000","last_clean":"2023-11-19T00:40:51.629535+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:51.629535+0000","last_undegraded":"2023-11-19T00:40:51.629535+0000","last_fullsized":"2023-11-19T00:40:51.629535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'140","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.861697+0000","last_change":"2023-11-19T00:41:08.861726+0000","last_active":"2023-11-19T00:41:08.861697+0000","last_peered":"2023-11-19T00:41:08.861697+0000","last_clean":"2023-11-19T00:41:08.861697+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:41:08.861697+0000","last_undegraded":"2023-11-19T00:41:08.861697+0000","last_fullsized":"2023-11-19T00:41:08.861697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'140","last_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_deep_scrub":"75'140","last_deep_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.861626+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:02.346222+0000","scrub_duration":0.0096612360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":473,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629510+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:50.629510+0000","last_peered":"2023-11-19T00:40:50.629510+0000","last_clean":"2023-11-19T00:40:50.629510+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:50.629510+0000","last_undegraded":"2023-11-19T00:40:50.629510+0000","last_fullsized":"2023-11-19T00:40:50.629510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:58.324049+0000","last_change":"2023-11-19T00:41:58.324092+0000","last_active":"2023-11-19T00:41:58.324049+0000","last_peered":"2023-11-19T00:41:58.324049+0000","last_clean":"2023-11-19T00:41:58.324049+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:41:58.324049+0000","last_undegraded":"2023-11-19T00:41:58.324049+0000","last_fullsized":"2023-11-19T00:41:58.324049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_clean_scrub_stamp":"2023-11-19T00:41:58.323959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:04.718851+0000","scrub_duration":0.0018957519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'236","reported_seq":315,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:53.485524+0000","last_change":"2023-11-19T00:41:53.485557+0000","last_active":"2023-11-19T00:41:53.485524+0000","last_peered":"2023-11-19T00:41:53.485524+0000","last_clean":"2023-11-19T00:41:53.485524+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:41:53.485524+0000","last_undegraded":"2023-11-19T00:41:53.485524+0000","last_fullsized":"2023-11-19T00:41:53.485524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'236","last_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_deep_scrub":"75'236","last_deep_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_clean_scrub_stamp":"2023-11-19T00:41:53.485439+0000","objects_scrubbed":63,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:20.013886+0000","scrub_duration":0.043385156000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995393+0000","last_change":"2023-11-19T00:40:25.678723+0000","last_active":"2023-11-19T00:41:00.995393+0000","last_peered":"2023-11-19T00:41:00.995393+0000","last_clean":"2023-11-19T00:41:00.995393+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:41:00.995393+0000","last_undegraded":"2023-11-19T00:41:00.995393+0000","last_fullsized":"2023-11-19T00:41:00.995393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"75'206","reported_seq":274,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.456295+0000","last_change":"2023-11-19T00:41:50.456322+0000","last_active":"2023-11-19T00:41:50.456295+0000","last_peered":"2023-11-19T00:41:50.456295+0000","last_clean":"2023-11-19T00:41:50.456295+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:41:50.456295+0000","last_undegraded":"2023-11-19T00:41:50.456295+0000","last_fullsized":"2023-11-19T00:41:50.456295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.456210+0000","objects_scrubbed":54,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:50:56.340582+0000","scrub_duration":0.037720240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"75'12","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:17.957067+0000","last_change":"2023-11-19T00:41:17.957098+0000","last_active":"2023-11-19T00:41:17.957067+0000","last_peered":"2023-11-19T00:41:17.957067+0000","last_clean":"2023-11-19T00:41:17.957067+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:41:17.957067+0000","last_undegraded":"2023-11-19T00:41:17.957067+0000","last_fullsized":"2023-11-19T00:41:17.957067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_clean_scrub_stamp":"2023-11-19T00:41:17.956986+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:03:50.209311+0000","scrub_duration":0.0041360729999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"75'2","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.876155+0000","last_change":"2023-11-19T00:41:39.876223+0000","last_active":"2023-11-19T00:41:39.876155+0000","last_peered":"2023-11-19T00:41:39.876155+0000","last_clean":"2023-11-19T00:41:39.876155+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:41:39.876155+0000","last_undegraded":"2023-11-19T00:41:39.876155+0000","last_fullsized":"2023-11-19T00:41:39.876155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.876064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:21.289896+0000","scrub_duration":0.0035587930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'159","reported_seq":238,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630043+0000","last_change":"2023-11-19T00:40:25.679271+0000","last_active":"2023-11-19T00:40:56.630043+0000","last_peered":"2023-11-19T00:40:56.630043+0000","last_clean":"2023-11-19T00:40:56.630043+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:40:56.630043+0000","last_undegraded":"2023-11-19T00:40:56.630043+0000","last_fullsized":"2023-11-19T00:40:56.630043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"47'3","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995362+0000","last_change":"2023-11-19T00:40:25.678627+0000","last_active":"2023-11-19T00:41:00.995362+0000","last_peered":"2023-11-19T00:41:00.995362+0000","last_clean":"2023-11-19T00:41:00.995362+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:41:00.995362+0000","last_undegraded":"2023-11-19T00:41:00.995362+0000","last_fullsized":"2023-11-19T00:41:00.995362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"75'225","reported_seq":540,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.058756+0000","last_change":"2023-11-19T00:41:42.058808+0000","last_active":"2023-11-19T00:41:42.058756+0000","last_peered":"2023-11-19T00:41:42.058756+0000","last_clean":"2023-11-19T00:41:42.058756+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:41:42.058756+0000","last_undegraded":"2023-11-19T00:41:42.058756+0000","last_fullsized":"2023-11-19T00:41:42.058756+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'225","last_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_deep_scrub":"75'225","last_deep_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.058668+0000","objects_scrubbed":58,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:08.830501+0000","scrub_duration":0.041143718000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'2","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443334+0000","last_change":"2023-11-19T00:40:49.637739+0000","last_active":"2023-11-19T00:41:01.443334+0000","last_peered":"2023-11-19T00:41:01.443334+0000","last_clean":"2023-11-19T00:41:01.443334+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:41:01.443334+0000","last_undegraded":"2023-11-19T00:41:01.443334+0000","last_fullsized":"2023-11-19T00:41:01.443334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"75'201","reported_seq":481,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.932131+0000","last_change":"2023-11-19T00:41:07.932168+0000","last_active":"2023-11-19T00:41:07.932131+0000","last_peered":"2023-11-19T00:41:07.932131+0000","last_clean":"2023-11-19T00:41:07.932131+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:41:07.932131+0000","last_undegraded":"2023-11-19T00:41:07.932131+0000","last_fullsized":"2023-11-19T00:41:07.932131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'201","last_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_deep_scrub":"75'201","last_deep_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.932043+0000","objects_scrubbed":56,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:52:53.830915+0000","scrub_duration":0.040909213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443304+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:41:01.443304+0000","last_peered":"2023-11-19T00:41:01.443304+0000","last_clean":"2023-11-19T00:41:01.443304+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:41:01.443304+0000","last_undegraded":"2023-11-19T00:41:01.443304+0000","last_fullsized":"2023-11-19T00:41:01.443304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":229,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545938+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:41:00.545938+0000","last_peered":"2023-11-19T00:41:00.545938+0000","last_clean":"2023-11-19T00:41:00.545938+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:41:00.545938+0000","last_undegraded":"2023-11-19T00:41:00.545938+0000","last_fullsized":"2023-11-19T00:41:00.545938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"75'24","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.195410+0000","last_change":"2023-11-19T00:41:26.195438+0000","last_active":"2023-11-19T00:41:26.195410+0000","last_peered":"2023-11-19T00:41:26.195410+0000","last_clean":"2023-11-19T00:41:26.195410+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:41:26.195410+0000","last_undegraded":"2023-11-19T00:41:26.195410+0000","last_fullsized":"2023-11-19T00:41:26.195410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'24","last_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_deep_scrub":"75'24","last_deep_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.195316+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:42.215791+0000","scrub_duration":0.010042868999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"75'237","reported_seq":550,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:31.880355+0000","last_change":"2023-11-19T00:41:31.880416+0000","last_active":"2023-11-19T00:41:31.880355+0000","last_peered":"2023-11-19T00:41:31.880355+0000","last_clean":"2023-11-19T00:41:31.880355+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:41:31.880355+0000","last_undegraded":"2023-11-19T00:41:31.880355+0000","last_fullsized":"2023-11-19T00:41:31.880355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'237","last_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_deep_scrub":"75'237","last_deep_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_clean_scrub_stamp":"2023-11-19T00:41:31.880270+0000","objects_scrubbed":63,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:45:07.860358+0000","scrub_duration":0.045259584999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632301+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:56.632301+0000","last_peered":"2023-11-19T00:40:56.632301+0000","last_clean":"2023-11-19T00:40:56.632301+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:56.632301+0000","last_undegraded":"2023-11-19T00:40:56.632301+0000","last_fullsized":"2023-11-19T00:40:56.632301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'160","reported_seq":233,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443523+0000","last_change":"2023-11-19T00:40:49.639980+0000","last_active":"2023-11-19T00:41:01.443523+0000","last_peered":"2023-11-19T00:41:01.443523+0000","last_clean":"2023-11-19T00:41:01.443523+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:41:01.443523+0000","last_undegraded":"2023-11-19T00:41:01.443523+0000","last_fullsized":"2023-11-19T00:41:01.443523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630074+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:56.630074+0000","last_peered":"2023-11-19T00:40:56.630074+0000","last_clean":"2023-11-19T00:40:56.630074+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:56.630074+0000","last_undegraded":"2023-11-19T00:40:56.630074+0000","last_fullsized":"2023-11-19T00:40:56.630074+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"75'186","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.036628+0000","last_change":"2023-11-19T00:41:50.036692+0000","last_active":"2023-11-19T00:41:50.036628+0000","last_peered":"2023-11-19T00:41:50.036628+0000","last_clean":"2023-11-19T00:41:50.036628+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:41:50.036628+0000","last_undegraded":"2023-11-19T00:41:50.036628+0000","last_fullsized":"2023-11-19T00:41:50.036628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.036536+0000","objects_scrubbed":49,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:16.564983+0000","scrub_duration":0.040848061999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628665+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:50.628665+0000","last_peered":"2023-11-19T00:40:50.628665+0000","last_clean":"2023-11-19T00:40:50.628665+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:50.628665+0000","last_undegraded":"2023-11-19T00:40:50.628665+0000","last_fullsized":"2023-11-19T00:40:50.628665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"75'193","reported_seq":272,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.356161+0000","last_change":"2023-11-19T00:41:36.356189+0000","last_active":"2023-11-19T00:41:36.356161+0000","last_peered":"2023-11-19T00:41:36.356161+0000","last_clean":"2023-11-19T00:41:36.356161+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:41:36.356161+0000","last_undegraded":"2023-11-19T00:41:36.356161+0000","last_fullsized":"2023-11-19T00:41:36.356161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'193","last_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_deep_scrub":"75'193","last_deep_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.356083+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:24.448748+0000","scrub_duration":0.035468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":307,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827812+0000","last_change":"2023-11-19T00:40:49.637652+0000","last_active":"2023-11-19T00:40:50.827812+0000","last_peered":"2023-11-19T00:40:50.827812+0000","last_clean":"2023-11-19T00:40:50.827812+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:40:50.827812+0000","last_undegraded":"2023-11-19T00:40:50.827812+0000","last_fullsized":"2023-11-19T00:40:50.827812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:33.615993+0000","last_clean_scrub_stamp":"2023-11-19T00:38:33.615993+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828182+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:50.828182+0000","last_peered":"2023-11-19T00:40:50.828182+0000","last_clean":"2023-11-19T00:40:50.828182+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:50.828182+0000","last_undegraded":"2023-11-19T00:40:50.828182+0000","last_fullsized":"2023-11-19T00:40:50.828182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443252+0000","last_change":"2023-11-19T00:40:49.638045+0000","last_active":"2023-11-19T00:41:01.443252+0000","last_peered":"2023-11-19T00:41:01.443252+0000","last_clean":"2023-11-19T00:41:01.443252+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:41:01.443252+0000","last_undegraded":"2023-11-19T00:41:01.443252+0000","last_fullsized":"2023-11-19T00:41:01.443252+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":428,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631701+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:51.631701+0000","last_peered":"2023-11-19T00:40:51.631701+0000","last_clean":"2023-11-19T00:40:51.631701+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:51.631701+0000","last_undegraded":"2023-11-19T00:40:51.631701+0000","last_fullsized":"2023-11-19T00:40:51.631701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.827672+0000","last_change":"2023-11-19T00:40:49.636591+0000","last_active":"2023-11-19T00:40:50.827672+0000","last_peered":"2023-11-19T00:40:50.827672+0000","last_clean":"2023-11-19T00:40:50.827672+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:40:50.827672+0000","last_undegraded":"2023-11-19T00:40:50.827672+0000","last_fullsized":"2023-11-19T00:40:50.827672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"75'35","reported_seq":146,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:57.368468+0000","last_change":"2023-11-19T00:41:57.368492+0000","last_active":"2023-11-19T00:41:57.368468+0000","last_peered":"2023-11-19T00:41:57.368468+0000","last_clean":"2023-11-19T00:41:57.368468+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:41:57.368468+0000","last_undegraded":"2023-11-19T00:41:57.368468+0000","last_fullsized":"2023-11-19T00:41:57.368468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'35","last_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_deep_scrub":"75'35","last_deep_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_clean_scrub_stamp":"2023-11-19T00:41:57.368388+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:31.784985+0000","scrub_duration":0.0040954440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"75'208","reported_seq":718,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.122122+0000","last_change":"2023-11-19T00:41:07.122147+0000","last_active":"2023-11-19T00:41:07.122122+0000","last_peered":"2023-11-19T00:41:07.122122+0000","last_clean":"2023-11-19T00:41:07.122122+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:41:07.122122+0000","last_undegraded":"2023-11-19T00:41:07.122122+0000","last_fullsized":"2023-11-19T00:41:07.122122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'208","last_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_deep_scrub":"75'208","last_deep_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.122048+0000","objects_scrubbed":53,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:15.227402+0000","scrub_duration":0.037815080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.379460+0000","last_change":"2023-11-19T00:41:55.379498+0000","last_active":"2023-11-19T00:41:55.379460+0000","last_peered":"2023-11-19T00:41:55.379460+0000","last_clean":"2023-11-19T00:41:55.379460+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:41:55.379460+0000","last_undegraded":"2023-11-19T00:41:55.379460+0000","last_fullsized":"2023-11-19T00:41:55.379460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.379368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:42.997475+0000","scrub_duration":0.0022750370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"75'60","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.966230+0000","last_change":"2023-11-19T00:41:35.966258+0000","last_active":"2023-11-19T00:41:35.966230+0000","last_peered":"2023-11-19T00:41:35.966230+0000","last_clean":"2023-11-19T00:41:35.966230+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:41:35.966230+0000","last_undegraded":"2023-11-19T00:41:35.966230+0000","last_fullsized":"2023-11-19T00:41:35.966230+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.966137+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:39.525924+0000","scrub_duration":0.010289223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":680,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:58.634147+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:58.634147+0000","last_peered":"2023-11-19T00:40:58.634147+0000","last_clean":"2023-11-19T00:40:58.634147+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:58.634147+0000","last_undegraded":"2023-11-19T00:40:58.634147+0000","last_fullsized":"2023-11-19T00:40:58.634147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828389+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:50.828389+0000","last_peered":"2023-11-19T00:40:50.828389+0000","last_clean":"2023-11-19T00:40:50.828389+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:50.828389+0000","last_undegraded":"2023-11-19T00:40:50.828389+0000","last_fullsized":"2023-11-19T00:40:50.828389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631576+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:51.631576+0000","last_peered":"2023-11-19T00:40:51.631576+0000","last_clean":"2023-11-19T00:40:51.631576+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:51.631576+0000","last_undegraded":"2023-11-19T00:40:51.631576+0000","last_fullsized":"2023-11-19T00:40:51.631576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":456,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629292+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:50.629292+0000","last_peered":"2023-11-19T00:40:50.629292+0000","last_clean":"2023-11-19T00:40:50.629292+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:50.629292+0000","last_undegraded":"2023-11-19T00:40:50.629292+0000","last_fullsized":"2023-11-19T00:40:50.629292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:13.930783+0000","last_change":"2023-11-19T00:41:13.930804+0000","last_active":"2023-11-19T00:41:13.930783+0000","last_peered":"2023-11-19T00:41:13.930783+0000","last_clean":"2023-11-19T00:41:13.930783+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:41:13.930783+0000","last_undegraded":"2023-11-19T00:41:13.930783+0000","last_fullsized":"2023-11-19T00:41:13.930783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_clean_scrub_stamp":"2023-11-19T00:41:13.930701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:52.200874+0000","scrub_duration":0.001907448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.394157+0000","last_change":"2023-11-19T00:41:03.394178+0000","last_active":"2023-11-19T00:41:03.394157+0000","last_peered":"2023-11-19T00:41:03.394157+0000","last_clean":"2023-11-19T00:41:03.394157+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:41:03.394157+0000","last_undegraded":"2023-11-19T00:41:03.394157+0000","last_fullsized":"2023-11-19T00:41:03.394157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.394072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:55:33.909806+0000","scrub_duration":0.0022610909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":242,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:02.407225+0000","last_change":"2023-11-19T00:41:02.407245+0000","last_active":"2023-11-19T00:41:02.407225+0000","last_peered":"2023-11-19T00:41:02.407225+0000","last_clean":"2023-11-19T00:41:02.407225+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:41:02.407225+0000","last_undegraded":"2023-11-19T00:41:02.407225+0000","last_fullsized":"2023-11-19T00:41:02.407225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_clean_scrub_stamp":"2023-11-19T00:41:02.407143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:08:56.907868+0000","scrub_duration":0.001710039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.946911+0000","last_change":"2023-11-19T00:41:50.946932+0000","last_active":"2023-11-19T00:41:50.946911+0000","last_peered":"2023-11-19T00:41:50.946911+0000","last_clean":"2023-11-19T00:41:50.946911+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:41:50.946911+0000","last_undegraded":"2023-11-19T00:41:50.946911+0000","last_fullsized":"2023-11-19T00:41:50.946911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.946825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:53:57.831781+0000","scrub_duration":0.001540832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'177","reported_seq":250,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629525+0000","last_change":"2023-11-19T00:40:25.680402+0000","last_active":"2023-11-19T00:40:51.629525+0000","last_peered":"2023-11-19T00:40:51.629525+0000","last_clean":"2023-11-19T00:40:51.629525+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:40:51.629525+0000","last_undegraded":"2023-11-19T00:40:51.629525+0000","last_fullsized":"2023-11-19T00:40:51.629525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633535+0000","last_change":"2023-11-19T00:38:43.773493+0000","last_active":"2023-11-19T00:40:53.633535+0000","last_peered":"2023-11-19T00:40:53.633535+0000","last_clean":"2023-11-19T00:40:53.633535+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:40:53.633535+0000","last_undegraded":"2023-11-19T00:40:53.633535+0000","last_fullsized":"2023-11-19T00:40:53.633535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:33.306579+0000","last_change":"2023-11-19T00:41:33.306598+0000","last_active":"2023-11-19T00:41:33.306579+0000","last_peered":"2023-11-19T00:41:33.306579+0000","last_clean":"2023-11-19T00:41:33.306579+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:41:33.306579+0000","last_undegraded":"2023-11-19T00:41:33.306579+0000","last_fullsized":"2023-11-19T00:41:33.306579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_clean_scrub_stamp":"2023-11-19T00:41:33.306492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:54:35.500265+0000","scrub_duration":0.0019877990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:50.628529+0000","last_peered":"2023-11-19T00:40:50.628529+0000","last_clean":"2023-11-19T00:40:50.628529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:50.628529+0000","last_undegraded":"2023-11-19T00:40:50.628529+0000","last_fullsized":"2023-11-19T00:40:50.628529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"75'13","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.359683+0000","last_change":"2023-11-19T00:41:39.359724+0000","last_active":"2023-11-19T00:41:39.359683+0000","last_peered":"2023-11-19T00:41:39.359683+0000","last_clean":"2023-11-19T00:41:39.359683+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:41:39.359683+0000","last_undegraded":"2023-11-19T00:41:39.359683+0000","last_fullsized":"2023-11-19T00:41:39.359683+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'13","last_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_deep_scrub":"75'13","last_deep_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.359569+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:28.035657+0000","scrub_duration":0.0044493909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:18.983274+0000","last_change":"2023-11-19T00:41:18.983296+0000","last_active":"2023-11-19T00:41:18.983274+0000","last_peered":"2023-11-19T00:41:18.983274+0000","last_clean":"2023-11-19T00:41:18.983274+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:41:18.983274+0000","last_undegraded":"2023-11-19T00:41:18.983274+0000","last_fullsized":"2023-11-19T00:41:18.983274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_clean_scrub_stamp":"2023-11-19T00:41:18.983139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:41.254459+0000","scrub_duration":0.002267593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"75'186","reported_seq":284,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:32.952304+0000","last_change":"2023-11-19T00:41:32.952330+0000","last_active":"2023-11-19T00:41:32.952304+0000","last_peered":"2023-11-19T00:41:32.952304+0000","last_clean":"2023-11-19T00:41:32.952304+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:41:32.952304+0000","last_undegraded":"2023-11-19T00:41:32.952304+0000","last_fullsized":"2023-11-19T00:41:32.952304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_clean_scrub_stamp":"2023-11-19T00:41:32.952223+0000","objects_scrubbed":51,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:14.957145+0000","scrub_duration":0.037260673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":459,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443524+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:41:01.443524+0000","last_peered":"2023-11-19T00:41:01.443524+0000","last_clean":"2023-11-19T00:41:01.443524+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:41:01.443524+0000","last_undegraded":"2023-11-19T00:41:01.443524+0000","last_fullsized":"2023-11-19T00:41:01.443524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"75'46","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:34.879339+0000","last_change":"2023-11-19T00:41:34.879370+0000","last_active":"2023-11-19T00:41:34.879339+0000","last_peered":"2023-11-19T00:41:34.879339+0000","last_clean":"2023-11-19T00:41:34.879339+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:41:34.879339+0000","last_undegraded":"2023-11-19T00:41:34.879339+0000","last_fullsized":"2023-11-19T00:41:34.879339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_clean_scrub_stamp":"2023-11-19T00:41:34.879255+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:29.054637+0000","scrub_duration":0.011582451000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":629,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546002+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:41:00.546002+0000","last_peered":"2023-11-19T00:41:00.546002+0000","last_clean":"2023-11-19T00:41:00.546002+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:41:00.546002+0000","last_undegraded":"2023-11-19T00:41:00.546002+0000","last_fullsized":"2023-11-19T00:41:00.546002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"75'21","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.005846+0000","last_change":"2023-11-19T00:41:35.005876+0000","last_active":"2023-11-19T00:41:35.005846+0000","last_peered":"2023-11-19T00:41:35.005846+0000","last_clean":"2023-11-19T00:41:35.005846+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:41:35.005846+0000","last_undegraded":"2023-11-19T00:41:35.005846+0000","last_fullsized":"2023-11-19T00:41:35.005846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'21","last_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_deep_scrub":"75'21","last_deep_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.005745+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:31:58.190130+0000","scrub_duration":0.0037074590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:49.033609+0000","last_change":"2023-11-19T00:41:49.033646+0000","last_active":"2023-11-19T00:41:49.033609+0000","last_peered":"2023-11-19T00:41:49.033609+0000","last_clean":"2023-11-19T00:41:49.033609+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:41:49.033609+0000","last_undegraded":"2023-11-19T00:41:49.033609+0000","last_fullsized":"2023-11-19T00:41:49.033609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_clean_scrub_stamp":"2023-11-19T00:41:49.033509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:09.818062+0000","scrub_duration":0.0016660780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":239,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545941+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:41:00.545941+0000","last_peered":"2023-11-19T00:41:00.545941+0000","last_clean":"2023-11-19T00:41:00.545941+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:41:00.545941+0000","last_undegraded":"2023-11-19T00:41:00.545941+0000","last_fullsized":"2023-11-19T00:41:00.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545741+0000","last_change":"2023-11-19T00:38:43.775941+0000","last_active":"2023-11-19T00:41:00.545741+0000","last_peered":"2023-11-19T00:41:00.545741+0000","last_clean":"2023-11-19T00:41:00.545741+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:41:00.545741+0000","last_undegraded":"2023-11-19T00:41:00.545741+0000","last_fullsized":"2023-11-19T00:41:00.545741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":443,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628520+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:50.628520+0000","last_peered":"2023-11-19T00:40:50.628520+0000","last_clean":"2023-11-19T00:40:50.628520+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:50.628520+0000","last_undegraded":"2023-11-19T00:40:50.628520+0000","last_fullsized":"2023-11-19T00:40:50.628520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"59'163","reported_seq":241,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629928+0000","last_change":"2023-11-19T00:40:25.677700+0000","last_active":"2023-11-19T00:40:50.629928+0000","last_peered":"2023-11-19T00:40:50.629928+0000","last_clean":"2023-11-19T00:40:50.629928+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:40:50.629928+0000","last_undegraded":"2023-11-19T00:40:50.629928+0000","last_fullsized":"2023-11-19T00:40:50.629928+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:44.366153+0000","last_change":"2023-11-19T00:41:44.366204+0000","last_active":"2023-11-19T00:41:44.366153+0000","last_peered":"2023-11-19T00:41:44.366153+0000","last_clean":"2023-11-19T00:41:44.366153+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:41:44.366153+0000","last_undegraded":"2023-11-19T00:41:44.366153+0000","last_fullsized":"2023-11-19T00:41:44.366153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'1","last_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_deep_scrub":"45'1","last_deep_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_clean_scrub_stamp":"2023-11-19T00:41:44.366059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:07:42.639601+0000","scrub_duration":0.001898725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"75'202","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:19.306630+0000","last_change":"2023-11-19T00:41:19.306669+0000","last_active":"2023-11-19T00:41:19.306630+0000","last_peered":"2023-11-19T00:41:19.306630+0000","last_clean":"2023-11-19T00:41:19.306630+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:41:19.306630+0000","last_undegraded":"2023-11-19T00:41:19.306630+0000","last_fullsized":"2023-11-19T00:41:19.306630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'202","last_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_deep_scrub":"75'202","last_deep_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:19.306536+0000","objects_scrubbed":49,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:17.124610+0000","scrub_duration":0.034907383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:06.281328+0000","last_change":"2023-11-19T00:41:06.281350+0000","last_active":"2023-11-19T00:41:06.281328+0000","last_peered":"2023-11-19T00:41:06.281328+0000","last_clean":"2023-11-19T00:41:06.281328+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:41:06.281328+0000","last_undegraded":"2023-11-19T00:41:06.281328+0000","last_fullsized":"2023-11-19T00:41:06.281328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_clean_scrub_stamp":"2023-11-19T00:41:06.281244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:23.140955+0000","scrub_duration":0.0017497389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":240,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995676+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:41:00.995676+0000","last_peered":"2023-11-19T00:41:00.995676+0000","last_clean":"2023-11-19T00:41:00.995676+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:41:00.995676+0000","last_undegraded":"2023-11-19T00:41:00.995676+0000","last_fullsized":"2023-11-19T00:41:00.995676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995435+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:41:00.995435+0000","last_peered":"2023-11-19T00:41:00.995435+0000","last_clean":"2023-11-19T00:41:00.995435+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:41:00.995435+0000","last_undegraded":"2023-11-19T00:41:00.995435+0000","last_fullsized":"2023-11-19T00:41:00.995435+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"75'220","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.986982+0000","last_change":"2023-11-19T00:41:15.986982+0000","last_active":"2023-11-19T00:41:15.986982+0000","last_peered":"2023-11-19T00:41:15.986982+0000","last_clean":"2023-11-19T00:41:15.986982+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:41:15.986982+0000","last_undegraded":"2023-11-19T00:41:15.986982+0000","last_fullsized":"2023-11-19T00:41:15.986982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.986886+0000","objects_scrubbed":53,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:40.565603+0000","scrub_duration":0.036034849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"75'7","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:29.949945+0000","last_change":"2023-11-19T00:41:29.949973+0000","last_active":"2023-11-19T00:41:29.949945+0000","last_peered":"2023-11-19T00:41:29.949945+0000","last_clean":"2023-11-19T00:41:29.949945+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:41:29.949945+0000","last_undegraded":"2023-11-19T00:41:29.949945+0000","last_fullsized":"2023-11-19T00:41:29.949945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'7","last_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_deep_scrub":"75'7","last_deep_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_clean_scrub_stamp":"2023-11-19T00:41:29.949858+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:16:37.535582+0000","scrub_duration":0.009494878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'141","reported_seq":191,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443618+0000","last_change":"2023-11-19T00:40:49.648309+0000","last_active":"2023-11-19T00:41:01.443618+0000","last_peered":"2023-11-19T00:41:01.443618+0000","last_clean":"2023-11-19T00:41:01.443618+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:41:01.443618+0000","last_undegraded":"2023-11-19T00:41:01.443618+0000","last_fullsized":"2023-11-19T00:41:01.443618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443456+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:41:01.443456+0000","last_peered":"2023-11-19T00:41:01.443456+0000","last_clean":"2023-11-19T00:41:01.443456+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:41:01.443456+0000","last_undegraded":"2023-11-19T00:41:01.443456+0000","last_fullsized":"2023-11-19T00:41:01.443456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":214,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443590+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:41:01.443590+0000","last_peered":"2023-11-19T00:41:01.443590+0000","last_clean":"2023-11-19T00:41:01.443590+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:41:01.443590+0000","last_undegraded":"2023-11-19T00:41:01.443590+0000","last_fullsized":"2023-11-19T00:41:01.443590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"75'56","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.925143+0000","last_change":"2023-11-19T00:41:48.925171+0000","last_active":"2023-11-19T00:41:48.925143+0000","last_peered":"2023-11-19T00:41:48.925143+0000","last_clean":"2023-11-19T00:41:48.925143+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:41:48.925143+0000","last_undegraded":"2023-11-19T00:41:48.925143+0000","last_fullsized":"2023-11-19T00:41:48.925143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'56","last_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_deep_scrub":"75'56","last_deep_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.925067+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:26:37.416531+0000","scrub_duration":0.016421860999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"75'228","reported_seq":543,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.083829+0000","last_change":"2023-11-19T00:41:04.083863+0000","last_active":"2023-11-19T00:41:04.083829+0000","last_peered":"2023-11-19T00:41:04.083829+0000","last_clean":"2023-11-19T00:41:04.083829+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:41:04.083829+0000","last_undegraded":"2023-11-19T00:41:04.083829+0000","last_fullsized":"2023-11-19T00:41:04.083829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'228","last_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_deep_scrub":"75'228","last_deep_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.083754+0000","objects_scrubbed":57,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:04:56.786572+0000","scrub_duration":0.039326976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"44'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629900+0000","last_change":"2023-11-19T00:38:43.776753+0000","last_active":"2023-11-19T00:40:50.629900+0000","last_peered":"2023-11-19T00:40:50.629900+0000","last_clean":"2023-11-19T00:40:50.629900+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:40:50.629900+0000","last_undegraded":"2023-11-19T00:40:50.629900+0000","last_fullsized":"2023-11-19T00:40:50.629900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"75'254","reported_seq":579,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:45.012072+0000","last_change":"2023-11-19T00:41:45.012108+0000","last_active":"2023-11-19T00:41:45.012072+0000","last_peered":"2023-11-19T00:41:45.012072+0000","last_clean":"2023-11-19T00:41:45.012072+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:41:45.012072+0000","last_undegraded":"2023-11-19T00:41:45.012072+0000","last_fullsized":"2023-11-19T00:41:45.012072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'254","last_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_deep_scrub":"75'254","last_deep_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_clean_scrub_stamp":"2023-11-19T00:41:45.011994+0000","objects_scrubbed":64,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:03.705015+0000","scrub_duration":0.043843721000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"75'18","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:11.205693+0000","last_change":"2023-11-19T00:41:11.205737+0000","last_active":"2023-11-19T00:41:11.205693+0000","last_peered":"2023-11-19T00:41:11.205693+0000","last_clean":"2023-11-19T00:41:11.205693+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:41:11.205693+0000","last_undegraded":"2023-11-19T00:41:11.205693+0000","last_fullsized":"2023-11-19T00:41:11.205693+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'18","last_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_deep_scrub":"75'18","last_deep_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_clean_scrub_stamp":"2023-11-19T00:41:11.205579+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:37.711995+0000","scrub_duration":0.010464658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11907,"ondisk_log_size":11907,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":458,"ondisk_log_size":458,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103152,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94268688,"statfs":{"total":96636764160,"available":96531136512,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.186,"5min":0.156,"15min":0.156},"max":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.434},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.60899999999999999,"5min":0.625,"15min":0.625},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Nov 19 00:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.59299999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.443,"15min":0.45500000000000002},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.441}]}]},{"osd":2,"up_from":8,"seq":34359738414,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105908,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94265932,"statfs":{"total":96636764160,"available":96528314368,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.27100000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.47599999999999998},"min":{"1min":0.255,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Nov 19 00:41:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60699999999999998,"5min":0.63,"15min":0.63},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.46600000000000003},"min":{"1min":0.26200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113284,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94258556,"statfs":{"total":96636764160,"available":96520761344,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.625},"last":0.36199999999999999}]},{"osd":2,"last update":"Sun Nov 19 00:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.29899999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.47599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:42:02.827 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.828 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.828 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.828 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.828 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.829 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.829 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.829 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.829 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.829 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.830 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.830 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.830 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.830 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.830 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.830 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.831 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.831 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.831 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.831 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.831 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.832 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.832 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.832 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.832 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.832 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.832 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-19T00:38:33.615993+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=33, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.833 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.833 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.833 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.833 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.833 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.834 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.834 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.834 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.834 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.834 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.834 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.835 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.835 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.835 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.835 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.835 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.836 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.836 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.836 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.836 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.836 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.836 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.837 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.837 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:02.837 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-19T00:42:22.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:42:23.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:42:23.152 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:42:23.161 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-11-19T00:42:23.070108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13102,"ondisk_log_size":13102,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":314024,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282801496,"statfs":{"total":289910292480,"available":289588731904,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003325"},"pg_stats":[{"pgid":"4.3f","version":"75'215","reported_seq":511,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.015170+0000","last_change":"2023-11-19T00:41:12.015195+0000","last_active":"2023-11-19T00:41:12.015170+0000","last_peered":"2023-11-19T00:41:12.015170+0000","last_clean":"2023-11-19T00:41:12.015170+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:41:12.015170+0000","last_undegraded":"2023-11-19T00:41:12.015170+0000","last_fullsized":"2023-11-19T00:41:12.015170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.015097+0000","objects_scrubbed":50,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:27.053797+0000","scrub_duration":0.036690850999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"75'207","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:04.947403+0000","last_change":"2023-11-19T00:42:04.947449+0000","last_active":"2023-11-19T00:42:04.947403+0000","last_peered":"2023-11-19T00:42:04.947403+0000","last_clean":"2023-11-19T00:42:04.947403+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:42:04.947403+0000","last_undegraded":"2023-11-19T00:42:04.947403+0000","last_fullsized":"2023-11-19T00:42:04.947403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_clean_scrub_stamp":"2023-11-19T00:42:04.947330+0000","objects_scrubbed":45,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:45:23.142624+0000","scrub_duration":0.031262616999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"75'207","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.223196+0000","last_change":"2023-11-19T00:42:13.223244+0000","last_active":"2023-11-19T00:42:13.223196+0000","last_peered":"2023-11-19T00:42:13.223196+0000","last_clean":"2023-11-19T00:42:13.223196+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:42:13.223196+0000","last_undegraded":"2023-11-19T00:42:13.223196+0000","last_fullsized":"2023-11-19T00:42:13.223196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.223119+0000","objects_scrubbed":39,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:01:18.136942+0000","scrub_duration":0.027099018999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"75'172","reported_seq":232,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:10.950084+0000","last_change":"2023-11-19T00:41:10.950107+0000","last_active":"2023-11-19T00:41:10.950084+0000","last_peered":"2023-11-19T00:41:10.950084+0000","last_clean":"2023-11-19T00:41:10.950084+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:41:10.950084+0000","last_undegraded":"2023-11-19T00:41:10.950084+0000","last_fullsized":"2023-11-19T00:41:10.950084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'172","last_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_deep_scrub":"75'172","last_deep_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_clean_scrub_stamp":"2023-11-19T00:41:10.950010+0000","objects_scrubbed":51,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:03.687754+0000","scrub_duration":0.034903271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":498,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629503+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:51.629503+0000","last_peered":"2023-11-19T00:40:51.629503+0000","last_clean":"2023-11-19T00:40:51.629503+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:51.629503+0000","last_undegraded":"2023-11-19T00:40:51.629503+0000","last_fullsized":"2023-11-19T00:40:51.629503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"59'166","reported_seq":454,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443783+0000","last_change":"2023-11-19T00:40:49.649517+0000","last_active":"2023-11-19T00:41:01.443783+0000","last_peered":"2023-11-19T00:41:01.443783+0000","last_clean":"2023-11-19T00:41:01.443783+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:41:01.443783+0000","last_undegraded":"2023-11-19T00:41:01.443783+0000","last_fullsized":"2023-11-19T00:41:01.443783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"75'227","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:41.910516+0000","last_change":"2023-11-19T00:41:41.910554+0000","last_active":"2023-11-19T00:41:41.910516+0000","last_peered":"2023-11-19T00:41:41.910516+0000","last_clean":"2023-11-19T00:41:41.910516+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:41:41.910516+0000","last_undegraded":"2023-11-19T00:41:41.910516+0000","last_fullsized":"2023-11-19T00:41:41.910516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'227","last_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_deep_scrub":"75'227","last_deep_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_clean_scrub_stamp":"2023-11-19T00:41:41.910446+0000","objects_scrubbed":62,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:52.519112+0000","scrub_duration":0.043757361000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"75'179","reported_seq":426,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.949857+0000","last_change":"2023-11-19T00:41:36.949897+0000","last_active":"2023-11-19T00:41:36.949857+0000","last_peered":"2023-11-19T00:41:36.949857+0000","last_clean":"2023-11-19T00:41:36.949857+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:41:36.949857+0000","last_undegraded":"2023-11-19T00:41:36.949857+0000","last_fullsized":"2023-11-19T00:41:36.949857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'179","last_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_deep_scrub":"75'179","last_deep_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.949768+0000","objects_scrubbed":48,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:32.130529+0000","scrub_duration":0.033692611999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.238253+0000","last_change":"2023-11-19T00:41:08.238253+0000","last_active":"2023-11-19T00:41:08.238253+0000","last_peered":"2023-11-19T00:41:08.238253+0000","last_clean":"2023-11-19T00:41:08.238253+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:41:08.238253+0000","last_undegraded":"2023-11-19T00:41:08.238253+0000","last_fullsized":"2023-11-19T00:41:08.238253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.238154+0000","objects_scrubbed":51,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:28:28.657653+0000","scrub_duration":0.035756160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"59'148","reported_seq":412,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629401+0000","last_change":"2023-11-19T00:40:49.644636+0000","last_active":"2023-11-19T00:40:50.629401+0000","last_peered":"2023-11-19T00:40:50.629401+0000","last_clean":"2023-11-19T00:40:50.629401+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:40:50.629401+0000","last_undegraded":"2023-11-19T00:40:50.629401+0000","last_fullsized":"2023-11-19T00:40:50.629401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"75'215","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.969246+0000","last_change":"2023-11-19T00:41:15.969271+0000","last_active":"2023-11-19T00:41:15.969246+0000","last_peered":"2023-11-19T00:41:15.969246+0000","last_clean":"2023-11-19T00:41:15.969246+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:41:15.969246+0000","last_undegraded":"2023-11-19T00:41:15.969246+0000","last_fullsized":"2023-11-19T00:41:15.969246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.969180+0000","objects_scrubbed":56,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:37:03.160511+0000","scrub_duration":0.046149739000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"75'191","reported_seq":277,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.898049+0000","last_change":"2023-11-19T00:42:20.898107+0000","last_active":"2023-11-19T00:42:20.898049+0000","last_peered":"2023-11-19T00:42:20.898049+0000","last_clean":"2023-11-19T00:42:20.898049+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:42:20.898049+0000","last_undegraded":"2023-11-19T00:42:20.898049+0000","last_fullsized":"2023-11-19T00:42:20.898049+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'191","last_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_deep_scrub":"75'191","last_deep_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.897961+0000","objects_scrubbed":55,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:41.542056+0000","scrub_duration":0.041092573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"75'183","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:09.037090+0000","last_change":"2023-11-19T00:41:09.037113+0000","last_active":"2023-11-19T00:41:09.037090+0000","last_peered":"2023-11-19T00:41:09.037090+0000","last_clean":"2023-11-19T00:41:09.037090+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:41:09.037090+0000","last_undegraded":"2023-11-19T00:41:09.037090+0000","last_fullsized":"2023-11-19T00:41:09.037090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'183","last_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_deep_scrub":"75'183","last_deep_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_clean_scrub_stamp":"2023-11-19T00:41:09.037014+0000","objects_scrubbed":50,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:26.814001+0000","scrub_duration":0.033302804999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"75'224","reported_seq":724,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:52.995941+0000","last_change":"2023-11-19T00:41:52.995980+0000","last_active":"2023-11-19T00:41:52.995941+0000","last_peered":"2023-11-19T00:41:52.995941+0000","last_clean":"2023-11-19T00:41:52.995941+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:41:52.995941+0000","last_undegraded":"2023-11-19T00:41:52.995941+0000","last_fullsized":"2023-11-19T00:41:52.995941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'224","last_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_deep_scrub":"75'224","last_deep_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_clean_scrub_stamp":"2023-11-19T00:41:52.995854+0000","objects_scrubbed":44,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:27.412450+0000","scrub_duration":0.030047951999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"75'206","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.250517+0000","last_change":"2023-11-19T00:42:07.250542+0000","last_active":"2023-11-19T00:42:07.250517+0000","last_peered":"2023-11-19T00:42:07.250517+0000","last_clean":"2023-11-19T00:42:07.250517+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:42:07.250517+0000","last_undegraded":"2023-11-19T00:42:07.250517+0000","last_fullsized":"2023-11-19T00:42:07.250517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.250444+0000","objects_scrubbed":50,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:41:30.400474+0000","scrub_duration":0.034619200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'231","reported_seq":298,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:51.008109+0000","last_change":"2023-11-19T00:41:51.008143+0000","last_active":"2023-11-19T00:41:51.008109+0000","last_peered":"2023-11-19T00:41:51.008109+0000","last_clean":"2023-11-19T00:41:51.008109+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:41:51.008109+0000","last_undegraded":"2023-11-19T00:41:51.008109+0000","last_fullsized":"2023-11-19T00:41:51.008109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_clean_scrub_stamp":"2023-11-19T00:41:51.008026+0000","objects_scrubbed":58,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:38.626133+0000","scrub_duration":0.041732172999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"75'207","reported_seq":286,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.461743+0000","last_change":"2023-11-19T00:41:48.461784+0000","last_active":"2023-11-19T00:41:48.461743+0000","last_peered":"2023-11-19T00:41:48.461743+0000","last_clean":"2023-11-19T00:41:48.461743+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:41:48.461743+0000","last_undegraded":"2023-11-19T00:41:48.461743+0000","last_fullsized":"2023-11-19T00:41:48.461743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.461644+0000","objects_scrubbed":53,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:30:42.739782+0000","scrub_duration":0.045335093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"75'199","reported_seq":483,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.090823+0000","last_change":"2023-11-19T00:41:03.090862+0000","last_active":"2023-11-19T00:41:03.090823+0000","last_peered":"2023-11-19T00:41:03.090823+0000","last_clean":"2023-11-19T00:41:03.090823+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:41:03.090823+0000","last_undegraded":"2023-11-19T00:41:03.090823+0000","last_fullsized":"2023-11-19T00:41:03.090823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.090716+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:42.528537+0000","scrub_duration":0.045074112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'145","reported_seq":417,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629306+0000","last_change":"2023-11-19T00:40:47.637403+0000","last_active":"2023-11-19T00:40:50.629306+0000","last_peered":"2023-11-19T00:40:50.629306+0000","last_clean":"2023-11-19T00:40:50.629306+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:40:50.629306+0000","last_undegraded":"2023-11-19T00:40:50.629306+0000","last_fullsized":"2023-11-19T00:40:50.629306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"75'221","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.963592+0000","last_change":"2023-11-19T00:41:04.963623+0000","last_active":"2023-11-19T00:41:04.963592+0000","last_peered":"2023-11-19T00:41:04.963592+0000","last_clean":"2023-11-19T00:41:04.963592+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:41:04.963592+0000","last_undegraded":"2023-11-19T00:41:04.963592+0000","last_fullsized":"2023-11-19T00:41:04.963592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.963516+0000","objects_scrubbed":56,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:06.799626+0000","scrub_duration":0.039865746000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"75'217","reported_seq":275,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.942577+0000","last_change":"2023-11-19T00:41:12.942606+0000","last_active":"2023-11-19T00:41:12.942577+0000","last_peered":"2023-11-19T00:41:12.942577+0000","last_clean":"2023-11-19T00:41:12.942577+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:41:12.942577+0000","last_undegraded":"2023-11-19T00:41:12.942577+0000","last_fullsized":"2023-11-19T00:41:12.942577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'217","last_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_deep_scrub":"75'217","last_deep_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.942504+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:29.802215+0000","scrub_duration":0.042793523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:10.027915+0000","last_change":"2023-11-19T00:42:10.027942+0000","last_active":"2023-11-19T00:42:10.027915+0000","last_peered":"2023-11-19T00:42:10.027915+0000","last_clean":"2023-11-19T00:42:10.027915+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:42:10.027915+0000","last_undegraded":"2023-11-19T00:42:10.027915+0000","last_fullsized":"2023-11-19T00:42:10.027915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_clean_scrub_stamp":"2023-11-19T00:42:10.027812+0000","objects_scrubbed":54,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:40.543546+0000","scrub_duration":0.042942501000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"75'211","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.392748+0000","last_change":"2023-11-19T00:41:42.392777+0000","last_active":"2023-11-19T00:41:42.392748+0000","last_peered":"2023-11-19T00:41:42.392748+0000","last_clean":"2023-11-19T00:41:42.392748+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:41:42.392748+0000","last_undegraded":"2023-11-19T00:41:42.392748+0000","last_fullsized":"2023-11-19T00:41:42.392748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.392663+0000","objects_scrubbed":60,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:23.806495+0000","scrub_duration":0.040785126999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"59'163","reported_seq":218,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630031+0000","last_change":"2023-11-19T00:40:47.645817+0000","last_active":"2023-11-19T00:40:56.630031+0000","last_peered":"2023-11-19T00:40:56.630031+0000","last_clean":"2023-11-19T00:40:56.630031+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:40:56.630031+0000","last_undegraded":"2023-11-19T00:40:56.630031+0000","last_fullsized":"2023-11-19T00:40:56.630031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"75'213","reported_seq":312,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.956972+0000","last_change":"2023-11-19T00:41:26.957022+0000","last_active":"2023-11-19T00:41:26.956972+0000","last_peered":"2023-11-19T00:41:26.956972+0000","last_clean":"2023-11-19T00:41:26.956972+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:41:26.956972+0000","last_undegraded":"2023-11-19T00:41:26.956972+0000","last_fullsized":"2023-11-19T00:41:26.956972+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.956876+0000","objects_scrubbed":53,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:31:00.258795+0000","scrub_duration":0.041573285000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"75'246","reported_seq":325,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:30.252873+0000","last_change":"2023-11-19T00:41:30.252904+0000","last_active":"2023-11-19T00:41:30.252873+0000","last_peered":"2023-11-19T00:41:30.252873+0000","last_clean":"2023-11-19T00:41:30.252873+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:41:30.252873+0000","last_undegraded":"2023-11-19T00:41:30.252873+0000","last_fullsized":"2023-11-19T00:41:30.252873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'246","last_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_deep_scrub":"75'246","last_deep_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_clean_scrub_stamp":"2023-11-19T00:41:30.252803+0000","objects_scrubbed":61,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:05:30.610485+0000","scrub_duration":0.045754178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"75'200","reported_seq":283,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.237889+0000","last_change":"2023-11-19T00:42:15.237917+0000","last_active":"2023-11-19T00:42:15.237889+0000","last_peered":"2023-11-19T00:42:15.237889+0000","last_clean":"2023-11-19T00:42:15.237889+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:42:15.237889+0000","last_undegraded":"2023-11-19T00:42:15.237889+0000","last_fullsized":"2023-11-19T00:42:15.237889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.237806+0000","objects_scrubbed":52,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:11:37.875363+0000","scrub_duration":0.035472484999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"75'195","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:14.991821+0000","last_change":"2023-11-19T00:41:14.991861+0000","last_active":"2023-11-19T00:41:14.991821+0000","last_peered":"2023-11-19T00:41:14.991821+0000","last_clean":"2023-11-19T00:41:14.991821+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:41:14.991821+0000","last_undegraded":"2023-11-19T00:41:14.991821+0000","last_fullsized":"2023-11-19T00:41:14.991821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'195","last_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_deep_scrub":"75'195","last_deep_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_clean_scrub_stamp":"2023-11-19T00:41:14.991747+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:33.385240+0000","scrub_duration":0.031971732000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":669,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633329+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:53.633329+0000","last_peered":"2023-11-19T00:40:53.633329+0000","last_clean":"2023-11-19T00:40:53.633329+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:53.633329+0000","last_undegraded":"2023-11-19T00:40:53.633329+0000","last_fullsized":"2023-11-19T00:40:53.633329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"59'189","reported_seq":268,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629483+0000","last_change":"2023-11-19T00:40:25.679280+0000","last_active":"2023-11-19T00:40:51.629483+0000","last_peered":"2023-11-19T00:40:51.629483+0000","last_clean":"2023-11-19T00:40:51.629483+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:40:51.629483+0000","last_undegraded":"2023-11-19T00:40:51.629483+0000","last_fullsized":"2023-11-19T00:40:51.629483+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'194","reported_seq":771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633231+0000","last_change":"2023-11-19T00:40:49.632467+0000","last_active":"2023-11-19T00:40:53.633231+0000","last_peered":"2023-11-19T00:40:53.633231+0000","last_clean":"2023-11-19T00:40:53.633231+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:40:53.633231+0000","last_undegraded":"2023-11-19T00:40:53.633231+0000","last_fullsized":"2023-11-19T00:40:53.633231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"75'234","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.033187+0000","last_change":"2023-11-19T00:41:55.033234+0000","last_active":"2023-11-19T00:41:55.033187+0000","last_peered":"2023-11-19T00:41:55.033187+0000","last_clean":"2023-11-19T00:41:55.033187+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:41:55.033187+0000","last_undegraded":"2023-11-19T00:41:55.033187+0000","last_fullsized":"2023-11-19T00:41:55.033187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'234","last_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_deep_scrub":"75'234","last_deep_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.033097+0000","objects_scrubbed":50,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:01.427989+0000","scrub_duration":0.036056435999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":404,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629535+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:51.629535+0000","last_peered":"2023-11-19T00:40:51.629535+0000","last_clean":"2023-11-19T00:40:51.629535+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:51.629535+0000","last_undegraded":"2023-11-19T00:40:51.629535+0000","last_fullsized":"2023-11-19T00:40:51.629535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'140","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.861697+0000","last_change":"2023-11-19T00:41:08.861726+0000","last_active":"2023-11-19T00:41:08.861697+0000","last_peered":"2023-11-19T00:41:08.861697+0000","last_clean":"2023-11-19T00:41:08.861697+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:41:08.861697+0000","last_undegraded":"2023-11-19T00:41:08.861697+0000","last_fullsized":"2023-11-19T00:41:08.861697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'140","last_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_deep_scrub":"75'140","last_deep_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.861626+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:02.346222+0000","scrub_duration":0.0096612360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":473,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629510+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:50.629510+0000","last_peered":"2023-11-19T00:40:50.629510+0000","last_clean":"2023-11-19T00:40:50.629510+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:50.629510+0000","last_undegraded":"2023-11-19T00:40:50.629510+0000","last_fullsized":"2023-11-19T00:40:50.629510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:58.324049+0000","last_change":"2023-11-19T00:41:58.324092+0000","last_active":"2023-11-19T00:41:58.324049+0000","last_peered":"2023-11-19T00:41:58.324049+0000","last_clean":"2023-11-19T00:41:58.324049+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:41:58.324049+0000","last_undegraded":"2023-11-19T00:41:58.324049+0000","last_fullsized":"2023-11-19T00:41:58.324049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_clean_scrub_stamp":"2023-11-19T00:41:58.323959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:04.718851+0000","scrub_duration":0.0018957519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'236","reported_seq":315,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:53.485524+0000","last_change":"2023-11-19T00:41:53.485557+0000","last_active":"2023-11-19T00:41:53.485524+0000","last_peered":"2023-11-19T00:41:53.485524+0000","last_clean":"2023-11-19T00:41:53.485524+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:41:53.485524+0000","last_undegraded":"2023-11-19T00:41:53.485524+0000","last_fullsized":"2023-11-19T00:41:53.485524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'236","last_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_deep_scrub":"75'236","last_deep_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_clean_scrub_stamp":"2023-11-19T00:41:53.485439+0000","objects_scrubbed":63,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:20.013886+0000","scrub_duration":0.043385156000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:19.896895+0000","last_change":"2023-11-19T00:42:19.896917+0000","last_active":"2023-11-19T00:42:19.896895+0000","last_peered":"2023-11-19T00:42:19.896895+0000","last_clean":"2023-11-19T00:42:19.896895+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:42:19.896895+0000","last_undegraded":"2023-11-19T00:42:19.896895+0000","last_fullsized":"2023-11-19T00:42:19.896895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_clean_scrub_stamp":"2023-11-19T00:42:19.896803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:36:46.403219+0000","scrub_duration":0.0019930909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"75'206","reported_seq":274,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.456295+0000","last_change":"2023-11-19T00:41:50.456322+0000","last_active":"2023-11-19T00:41:50.456295+0000","last_peered":"2023-11-19T00:41:50.456295+0000","last_clean":"2023-11-19T00:41:50.456295+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:41:50.456295+0000","last_undegraded":"2023-11-19T00:41:50.456295+0000","last_fullsized":"2023-11-19T00:41:50.456295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.456210+0000","objects_scrubbed":54,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:50:56.340582+0000","scrub_duration":0.037720240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"75'12","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:17.957067+0000","last_change":"2023-11-19T00:41:17.957098+0000","last_active":"2023-11-19T00:41:17.957067+0000","last_peered":"2023-11-19T00:41:17.957067+0000","last_clean":"2023-11-19T00:41:17.957067+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:41:17.957067+0000","last_undegraded":"2023-11-19T00:41:17.957067+0000","last_fullsized":"2023-11-19T00:41:17.957067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_clean_scrub_stamp":"2023-11-19T00:41:17.956986+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:03:50.209311+0000","scrub_duration":0.0041360729999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"75'2","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.876155+0000","last_change":"2023-11-19T00:41:39.876223+0000","last_active":"2023-11-19T00:41:39.876155+0000","last_peered":"2023-11-19T00:41:39.876155+0000","last_clean":"2023-11-19T00:41:39.876155+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:41:39.876155+0000","last_undegraded":"2023-11-19T00:41:39.876155+0000","last_fullsized":"2023-11-19T00:41:39.876155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.876064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:21.289896+0000","scrub_duration":0.0035587930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"75'211","reported_seq":300,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.930138+0000","last_change":"2023-11-19T00:42:15.930166+0000","last_active":"2023-11-19T00:42:15.930138+0000","last_peered":"2023-11-19T00:42:15.930138+0000","last_clean":"2023-11-19T00:42:15.930138+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:42:15.930138+0000","last_undegraded":"2023-11-19T00:42:15.930138+0000","last_fullsized":"2023-11-19T00:42:15.930138+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.930063+0000","objects_scrubbed":52,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:39:54.200236+0000","scrub_duration":0.037878510999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"75'4","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.934069+0000","last_change":"2023-11-19T00:42:05.934099+0000","last_active":"2023-11-19T00:42:05.934069+0000","last_peered":"2023-11-19T00:42:05.934069+0000","last_clean":"2023-11-19T00:42:05.934069+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:42:05.934069+0000","last_undegraded":"2023-11-19T00:42:05.934069+0000","last_fullsized":"2023-11-19T00:42:05.934069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.933982+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:00:07.479529+0000","scrub_duration":0.0031029730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"75'225","reported_seq":540,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.058756+0000","last_change":"2023-11-19T00:41:42.058808+0000","last_active":"2023-11-19T00:41:42.058756+0000","last_peered":"2023-11-19T00:41:42.058756+0000","last_clean":"2023-11-19T00:41:42.058756+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:41:42.058756+0000","last_undegraded":"2023-11-19T00:41:42.058756+0000","last_fullsized":"2023-11-19T00:41:42.058756+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'225","last_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_deep_scrub":"75'225","last_deep_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.058668+0000","objects_scrubbed":58,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:08.830501+0000","scrub_duration":0.041143718000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"75'3","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:21.189979+0000","last_change":"2023-11-19T00:42:21.190005+0000","last_active":"2023-11-19T00:42:21.189979+0000","last_peered":"2023-11-19T00:42:21.189979+0000","last_clean":"2023-11-19T00:42:21.189979+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:42:21.189979+0000","last_undegraded":"2023-11-19T00:42:21.189979+0000","last_fullsized":"2023-11-19T00:42:21.189979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_clean_scrub_stamp":"2023-11-19T00:42:21.189891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:08.734785+0000","scrub_duration":0.0034598979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"75'201","reported_seq":481,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.932131+0000","last_change":"2023-11-19T00:41:07.932168+0000","last_active":"2023-11-19T00:41:07.932131+0000","last_peered":"2023-11-19T00:41:07.932131+0000","last_clean":"2023-11-19T00:41:07.932131+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:41:07.932131+0000","last_undegraded":"2023-11-19T00:41:07.932131+0000","last_fullsized":"2023-11-19T00:41:07.932131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'201","last_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_deep_scrub":"75'201","last_deep_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.932043+0000","objects_scrubbed":56,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:52:53.830915+0000","scrub_duration":0.040909213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443304+0000","last_change":"2023-11-19T00:40:49.650184+0000","last_active":"2023-11-19T00:41:01.443304+0000","last_peered":"2023-11-19T00:41:01.443304+0000","last_clean":"2023-11-19T00:41:01.443304+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:41:01.443304+0000","last_undegraded":"2023-11-19T00:41:01.443304+0000","last_fullsized":"2023-11-19T00:41:01.443304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'160","reported_seq":229,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545938+0000","last_change":"2023-11-19T00:38:44.773476+0000","last_active":"2023-11-19T00:41:00.545938+0000","last_peered":"2023-11-19T00:41:00.545938+0000","last_clean":"2023-11-19T00:41:00.545938+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:41:00.545938+0000","last_undegraded":"2023-11-19T00:41:00.545938+0000","last_fullsized":"2023-11-19T00:41:00.545938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"75'24","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.195410+0000","last_change":"2023-11-19T00:41:26.195438+0000","last_active":"2023-11-19T00:41:26.195410+0000","last_peered":"2023-11-19T00:41:26.195410+0000","last_clean":"2023-11-19T00:41:26.195410+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:41:26.195410+0000","last_undegraded":"2023-11-19T00:41:26.195410+0000","last_fullsized":"2023-11-19T00:41:26.195410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'24","last_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_deep_scrub":"75'24","last_deep_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.195316+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:42.215791+0000","scrub_duration":0.010042868999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"75'237","reported_seq":550,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:31.880355+0000","last_change":"2023-11-19T00:41:31.880416+0000","last_active":"2023-11-19T00:41:31.880355+0000","last_peered":"2023-11-19T00:41:31.880355+0000","last_clean":"2023-11-19T00:41:31.880355+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:41:31.880355+0000","last_undegraded":"2023-11-19T00:41:31.880355+0000","last_fullsized":"2023-11-19T00:41:31.880355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'237","last_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_deep_scrub":"75'237","last_deep_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_clean_scrub_stamp":"2023-11-19T00:41:31.880270+0000","objects_scrubbed":63,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:45:07.860358+0000","scrub_duration":0.045259584999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632301+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:56.632301+0000","last_peered":"2023-11-19T00:40:56.632301+0000","last_clean":"2023-11-19T00:40:56.632301+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:56.632301+0000","last_undegraded":"2023-11-19T00:40:56.632301+0000","last_fullsized":"2023-11-19T00:40:56.632301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"75'220","reported_seq":303,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.223699+0000","last_change":"2023-11-19T00:42:17.223729+0000","last_active":"2023-11-19T00:42:17.223699+0000","last_peered":"2023-11-19T00:42:17.223699+0000","last_clean":"2023-11-19T00:42:17.223699+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:42:17.223699+0000","last_undegraded":"2023-11-19T00:42:17.223699+0000","last_fullsized":"2023-11-19T00:42:17.223699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.223626+0000","objects_scrubbed":60,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:53.070995+0000","scrub_duration":0.040470229000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.630074+0000","last_change":"2023-11-19T00:40:25.678801+0000","last_active":"2023-11-19T00:40:56.630074+0000","last_peered":"2023-11-19T00:40:56.630074+0000","last_clean":"2023-11-19T00:40:56.630074+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:40:56.630074+0000","last_undegraded":"2023-11-19T00:40:56.630074+0000","last_fullsized":"2023-11-19T00:40:56.630074+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"75'186","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.036628+0000","last_change":"2023-11-19T00:41:50.036692+0000","last_active":"2023-11-19T00:41:50.036628+0000","last_peered":"2023-11-19T00:41:50.036628+0000","last_clean":"2023-11-19T00:41:50.036628+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:41:50.036628+0000","last_undegraded":"2023-11-19T00:41:50.036628+0000","last_fullsized":"2023-11-19T00:41:50.036628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.036536+0000","objects_scrubbed":49,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:16.564983+0000","scrub_duration":0.040848061999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628665+0000","last_change":"2023-11-19T00:40:47.644345+0000","last_active":"2023-11-19T00:40:50.628665+0000","last_peered":"2023-11-19T00:40:50.628665+0000","last_clean":"2023-11-19T00:40:50.628665+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:40:50.628665+0000","last_undegraded":"2023-11-19T00:40:50.628665+0000","last_fullsized":"2023-11-19T00:40:50.628665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"75'193","reported_seq":272,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.356161+0000","last_change":"2023-11-19T00:41:36.356189+0000","last_active":"2023-11-19T00:41:36.356161+0000","last_peered":"2023-11-19T00:41:36.356161+0000","last_clean":"2023-11-19T00:41:36.356161+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:41:36.356161+0000","last_undegraded":"2023-11-19T00:41:36.356161+0000","last_fullsized":"2023-11-19T00:41:36.356161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'193","last_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_deep_scrub":"75'193","last_deep_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.356083+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:24.448748+0000","scrub_duration":0.035468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"75'159","reported_seq":317,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:00.102726+0000","last_change":"2023-11-19T00:42:00.102757+0000","last_active":"2023-11-19T00:42:00.102726+0000","last_peered":"2023-11-19T00:42:00.102726+0000","last_clean":"2023-11-19T00:42:00.102726+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:42:00.102726+0000","last_undegraded":"2023-11-19T00:42:00.102726+0000","last_fullsized":"2023-11-19T00:42:00.102726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'159","last_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_deep_scrub":"75'159","last_deep_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_clean_scrub_stamp":"2023-11-19T00:42:00.102649+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:42.477629+0000","scrub_duration":0.0046503730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828182+0000","last_change":"2023-11-19T00:40:49.649133+0000","last_active":"2023-11-19T00:40:50.828182+0000","last_peered":"2023-11-19T00:40:50.828182+0000","last_clean":"2023-11-19T00:40:50.828182+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:40:50.828182+0000","last_undegraded":"2023-11-19T00:40:50.828182+0000","last_fullsized":"2023-11-19T00:40:50.828182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.188035+0000","last_change":"2023-11-19T00:42:20.188057+0000","last_active":"2023-11-19T00:42:20.188035+0000","last_peered":"2023-11-19T00:42:20.188035+0000","last_clean":"2023-11-19T00:42:20.188035+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:42:20.188035+0000","last_undegraded":"2023-11-19T00:42:20.188035+0000","last_fullsized":"2023-11-19T00:42:20.188035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'1","last_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_deep_scrub":"43'1","last_deep_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.187953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:45.835355+0000","scrub_duration":0.0019880190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"60'139","reported_seq":428,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631701+0000","last_change":"2023-11-19T00:40:49.639782+0000","last_active":"2023-11-19T00:40:51.631701+0000","last_peered":"2023-11-19T00:40:51.631701+0000","last_clean":"2023-11-19T00:40:51.631701+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:40:51.631701+0000","last_undegraded":"2023-11-19T00:40:51.631701+0000","last_fullsized":"2023-11-19T00:40:51.631701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.198539+0000","last_change":"2023-11-19T00:42:05.198576+0000","last_active":"2023-11-19T00:42:05.198539+0000","last_peered":"2023-11-19T00:42:05.198539+0000","last_clean":"2023-11-19T00:42:05.198539+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:42:05.198539+0000","last_undegraded":"2023-11-19T00:42:05.198539+0000","last_fullsized":"2023-11-19T00:42:05.198539+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.198443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:02.651958+0000","scrub_duration":0.0016848690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"75'35","reported_seq":146,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:57.368468+0000","last_change":"2023-11-19T00:41:57.368492+0000","last_active":"2023-11-19T00:41:57.368468+0000","last_peered":"2023-11-19T00:41:57.368468+0000","last_clean":"2023-11-19T00:41:57.368468+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:41:57.368468+0000","last_undegraded":"2023-11-19T00:41:57.368468+0000","last_fullsized":"2023-11-19T00:41:57.368468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'35","last_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_deep_scrub":"75'35","last_deep_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_clean_scrub_stamp":"2023-11-19T00:41:57.368388+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:31.784985+0000","scrub_duration":0.0040954440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"75'208","reported_seq":718,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.122122+0000","last_change":"2023-11-19T00:41:07.122147+0000","last_active":"2023-11-19T00:41:07.122122+0000","last_peered":"2023-11-19T00:41:07.122122+0000","last_clean":"2023-11-19T00:41:07.122122+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:41:07.122122+0000","last_undegraded":"2023-11-19T00:41:07.122122+0000","last_fullsized":"2023-11-19T00:41:07.122122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'208","last_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_deep_scrub":"75'208","last_deep_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.122048+0000","objects_scrubbed":53,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:15.227402+0000","scrub_duration":0.037815080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.379460+0000","last_change":"2023-11-19T00:41:55.379498+0000","last_active":"2023-11-19T00:41:55.379460+0000","last_peered":"2023-11-19T00:41:55.379460+0000","last_clean":"2023-11-19T00:41:55.379460+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:41:55.379460+0000","last_undegraded":"2023-11-19T00:41:55.379460+0000","last_fullsized":"2023-11-19T00:41:55.379460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.379368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:42.997475+0000","scrub_duration":0.0022750370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"75'60","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.966230+0000","last_change":"2023-11-19T00:41:35.966258+0000","last_active":"2023-11-19T00:41:35.966230+0000","last_peered":"2023-11-19T00:41:35.966230+0000","last_clean":"2023-11-19T00:41:35.966230+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:41:35.966230+0000","last_undegraded":"2023-11-19T00:41:35.966230+0000","last_fullsized":"2023-11-19T00:41:35.966230+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.966137+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:39.525924+0000","scrub_duration":0.010289223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":680,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:58.634147+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:58.634147+0000","last_peered":"2023-11-19T00:40:58.634147+0000","last_clean":"2023-11-19T00:40:58.634147+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:58.634147+0000","last_undegraded":"2023-11-19T00:40:58.634147+0000","last_fullsized":"2023-11-19T00:40:58.634147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828389+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:50.828389+0000","last_peered":"2023-11-19T00:40:50.828389+0000","last_clean":"2023-11-19T00:40:50.828389+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:50.828389+0000","last_undegraded":"2023-11-19T00:40:50.828389+0000","last_fullsized":"2023-11-19T00:40:50.828389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.631576+0000","last_change":"2023-11-19T00:40:49.648875+0000","last_active":"2023-11-19T00:40:51.631576+0000","last_peered":"2023-11-19T00:40:51.631576+0000","last_clean":"2023-11-19T00:40:51.631576+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:40:51.631576+0000","last_undegraded":"2023-11-19T00:40:51.631576+0000","last_fullsized":"2023-11-19T00:40:51.631576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":456,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629292+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:50.629292+0000","last_peered":"2023-11-19T00:40:50.629292+0000","last_clean":"2023-11-19T00:40:50.629292+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:50.629292+0000","last_undegraded":"2023-11-19T00:40:50.629292+0000","last_fullsized":"2023-11-19T00:40:50.629292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:13.930783+0000","last_change":"2023-11-19T00:41:13.930804+0000","last_active":"2023-11-19T00:41:13.930783+0000","last_peered":"2023-11-19T00:41:13.930783+0000","last_clean":"2023-11-19T00:41:13.930783+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:41:13.930783+0000","last_undegraded":"2023-11-19T00:41:13.930783+0000","last_fullsized":"2023-11-19T00:41:13.930783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_clean_scrub_stamp":"2023-11-19T00:41:13.930701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:52.200874+0000","scrub_duration":0.001907448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.394157+0000","last_change":"2023-11-19T00:41:03.394178+0000","last_active":"2023-11-19T00:41:03.394157+0000","last_peered":"2023-11-19T00:41:03.394157+0000","last_clean":"2023-11-19T00:41:03.394157+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:41:03.394157+0000","last_undegraded":"2023-11-19T00:41:03.394157+0000","last_fullsized":"2023-11-19T00:41:03.394157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.394072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:55:33.909806+0000","scrub_duration":0.0022610909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"59'151","reported_seq":242,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628794+0000","last_change":"2023-11-19T00:40:49.638925+0000","last_active":"2023-11-19T00:40:50.628794+0000","last_peered":"2023-11-19T00:40:50.628794+0000","last_clean":"2023-11-19T00:40:50.628794+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:40:50.628794+0000","last_undegraded":"2023-11-19T00:40:50.628794+0000","last_fullsized":"2023-11-19T00:40:50.628794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:02.407225+0000","last_change":"2023-11-19T00:41:02.407245+0000","last_active":"2023-11-19T00:41:02.407225+0000","last_peered":"2023-11-19T00:41:02.407225+0000","last_clean":"2023-11-19T00:41:02.407225+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:41:02.407225+0000","last_undegraded":"2023-11-19T00:41:02.407225+0000","last_fullsized":"2023-11-19T00:41:02.407225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_clean_scrub_stamp":"2023-11-19T00:41:02.407143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:08:56.907868+0000","scrub_duration":0.001710039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.946911+0000","last_change":"2023-11-19T00:41:50.946932+0000","last_active":"2023-11-19T00:41:50.946911+0000","last_peered":"2023-11-19T00:41:50.946911+0000","last_clean":"2023-11-19T00:41:50.946911+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:41:50.946911+0000","last_undegraded":"2023-11-19T00:41:50.946911+0000","last_fullsized":"2023-11-19T00:41:50.946911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.946825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:53:57.831781+0000","scrub_duration":0.001540832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"75'222","reported_seq":304,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.964232+0000","last_change":"2023-11-19T00:42:17.964280+0000","last_active":"2023-11-19T00:42:17.964232+0000","last_peered":"2023-11-19T00:42:17.964232+0000","last_clean":"2023-11-19T00:42:17.964232+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:42:17.964232+0000","last_undegraded":"2023-11-19T00:42:17.964232+0000","last_fullsized":"2023-11-19T00:42:17.964232+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'222","last_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_deep_scrub":"75'222","last_deep_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.964152+0000","objects_scrubbed":45,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:56.501645+0000","scrub_duration":0.030415533000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"75'3","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:01.281804+0000","last_change":"2023-11-19T00:42:01.281847+0000","last_active":"2023-11-19T00:42:01.281804+0000","last_peered":"2023-11-19T00:42:01.281804+0000","last_clean":"2023-11-19T00:42:01.281804+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:42:01.281804+0000","last_undegraded":"2023-11-19T00:42:01.281804+0000","last_fullsized":"2023-11-19T00:42:01.281804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_clean_scrub_stamp":"2023-11-19T00:42:01.281689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:43.656669+0000","scrub_duration":0.003362435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:33.306579+0000","last_change":"2023-11-19T00:41:33.306598+0000","last_active":"2023-11-19T00:41:33.306579+0000","last_peered":"2023-11-19T00:41:33.306579+0000","last_clean":"2023-11-19T00:41:33.306579+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:41:33.306579+0000","last_undegraded":"2023-11-19T00:41:33.306579+0000","last_fullsized":"2023-11-19T00:41:33.306579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_clean_scrub_stamp":"2023-11-19T00:41:33.306492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:54:35.500265+0000","scrub_duration":0.0019877990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:50.628529+0000","last_peered":"2023-11-19T00:40:50.628529+0000","last_clean":"2023-11-19T00:40:50.628529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:50.628529+0000","last_undegraded":"2023-11-19T00:40:50.628529+0000","last_fullsized":"2023-11-19T00:40:50.628529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"75'13","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.359683+0000","last_change":"2023-11-19T00:41:39.359724+0000","last_active":"2023-11-19T00:41:39.359683+0000","last_peered":"2023-11-19T00:41:39.359683+0000","last_clean":"2023-11-19T00:41:39.359683+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:41:39.359683+0000","last_undegraded":"2023-11-19T00:41:39.359683+0000","last_fullsized":"2023-11-19T00:41:39.359683+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'13","last_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_deep_scrub":"75'13","last_deep_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.359569+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:28.035657+0000","scrub_duration":0.0044493909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:18.983274+0000","last_change":"2023-11-19T00:41:18.983296+0000","last_active":"2023-11-19T00:41:18.983274+0000","last_peered":"2023-11-19T00:41:18.983274+0000","last_clean":"2023-11-19T00:41:18.983274+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:41:18.983274+0000","last_undegraded":"2023-11-19T00:41:18.983274+0000","last_fullsized":"2023-11-19T00:41:18.983274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_clean_scrub_stamp":"2023-11-19T00:41:18.983139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:41.254459+0000","scrub_duration":0.002267593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"75'186","reported_seq":284,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:32.952304+0000","last_change":"2023-11-19T00:41:32.952330+0000","last_active":"2023-11-19T00:41:32.952304+0000","last_peered":"2023-11-19T00:41:32.952304+0000","last_clean":"2023-11-19T00:41:32.952304+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:41:32.952304+0000","last_undegraded":"2023-11-19T00:41:32.952304+0000","last_fullsized":"2023-11-19T00:41:32.952304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_clean_scrub_stamp":"2023-11-19T00:41:32.952223+0000","objects_scrubbed":51,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:14.957145+0000","scrub_duration":0.037260673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'168","reported_seq":459,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443524+0000","last_change":"2023-11-19T00:40:49.636884+0000","last_active":"2023-11-19T00:41:01.443524+0000","last_peered":"2023-11-19T00:41:01.443524+0000","last_clean":"2023-11-19T00:41:01.443524+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:41:01.443524+0000","last_undegraded":"2023-11-19T00:41:01.443524+0000","last_fullsized":"2023-11-19T00:41:01.443524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"75'46","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:34.879339+0000","last_change":"2023-11-19T00:41:34.879370+0000","last_active":"2023-11-19T00:41:34.879339+0000","last_peered":"2023-11-19T00:41:34.879339+0000","last_clean":"2023-11-19T00:41:34.879339+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:41:34.879339+0000","last_undegraded":"2023-11-19T00:41:34.879339+0000","last_fullsized":"2023-11-19T00:41:34.879339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_clean_scrub_stamp":"2023-11-19T00:41:34.879255+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:29.054637+0000","scrub_duration":0.011582451000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"59'154","reported_seq":629,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.546002+0000","last_change":"2023-11-19T00:40:49.647005+0000","last_active":"2023-11-19T00:41:00.546002+0000","last_peered":"2023-11-19T00:41:00.546002+0000","last_clean":"2023-11-19T00:41:00.546002+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:41:00.546002+0000","last_undegraded":"2023-11-19T00:41:00.546002+0000","last_fullsized":"2023-11-19T00:41:00.546002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"75'21","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.005846+0000","last_change":"2023-11-19T00:41:35.005876+0000","last_active":"2023-11-19T00:41:35.005846+0000","last_peered":"2023-11-19T00:41:35.005846+0000","last_clean":"2023-11-19T00:41:35.005846+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:41:35.005846+0000","last_undegraded":"2023-11-19T00:41:35.005846+0000","last_fullsized":"2023-11-19T00:41:35.005846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'21","last_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_deep_scrub":"75'21","last_deep_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.005745+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:31:58.190130+0000","scrub_duration":0.0037074590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:49.033609+0000","last_change":"2023-11-19T00:41:49.033646+0000","last_active":"2023-11-19T00:41:49.033609+0000","last_peered":"2023-11-19T00:41:49.033609+0000","last_clean":"2023-11-19T00:41:49.033609+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:41:49.033609+0000","last_undegraded":"2023-11-19T00:41:49.033609+0000","last_fullsized":"2023-11-19T00:41:49.033609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_clean_scrub_stamp":"2023-11-19T00:41:49.033509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:09.818062+0000","scrub_duration":0.0016660780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'170","reported_seq":239,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.545941+0000","last_change":"2023-11-19T00:38:44.773568+0000","last_active":"2023-11-19T00:41:00.545941+0000","last_peered":"2023-11-19T00:41:00.545941+0000","last_clean":"2023-11-19T00:41:00.545941+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:41:00.545941+0000","last_undegraded":"2023-11-19T00:41:00.545941+0000","last_fullsized":"2023-11-19T00:41:00.545941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.247582+0000","last_change":"2023-11-19T00:42:07.247621+0000","last_active":"2023-11-19T00:42:07.247582+0000","last_peered":"2023-11-19T00:42:07.247582+0000","last_clean":"2023-11-19T00:42:07.247582+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:42:07.247582+0000","last_undegraded":"2023-11-19T00:42:07.247582+0000","last_fullsized":"2023-11-19T00:42:07.247582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.247482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:43.797824+0000","scrub_duration":0.0013240540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":443,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628520+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:50.628520+0000","last_peered":"2023-11-19T00:40:50.628520+0000","last_clean":"2023-11-19T00:40:50.628520+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:50.628520+0000","last_undegraded":"2023-11-19T00:40:50.628520+0000","last_fullsized":"2023-11-19T00:40:50.628520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'219","reported_seq":307,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.954334+0000","last_change":"2023-11-19T00:42:02.954366+0000","last_active":"2023-11-19T00:42:02.954334+0000","last_peered":"2023-11-19T00:42:02.954334+0000","last_clean":"2023-11-19T00:42:02.954334+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:42:02.954334+0000","last_undegraded":"2023-11-19T00:42:02.954334+0000","last_fullsized":"2023-11-19T00:42:02.954334+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'219","last_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_deep_scrub":"75'219","last_deep_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.954261+0000","objects_scrubbed":56,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:04.790371+0000","scrub_duration":0.040234886999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:44.366153+0000","last_change":"2023-11-19T00:41:44.366204+0000","last_active":"2023-11-19T00:41:44.366153+0000","last_peered":"2023-11-19T00:41:44.366153+0000","last_clean":"2023-11-19T00:41:44.366153+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:41:44.366153+0000","last_undegraded":"2023-11-19T00:41:44.366153+0000","last_fullsized":"2023-11-19T00:41:44.366153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'1","last_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_deep_scrub":"45'1","last_deep_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_clean_scrub_stamp":"2023-11-19T00:41:44.366059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:07:42.639601+0000","scrub_duration":0.001898725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"75'202","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:19.306630+0000","last_change":"2023-11-19T00:41:19.306669+0000","last_active":"2023-11-19T00:41:19.306630+0000","last_peered":"2023-11-19T00:41:19.306630+0000","last_clean":"2023-11-19T00:41:19.306630+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:41:19.306630+0000","last_undegraded":"2023-11-19T00:41:19.306630+0000","last_fullsized":"2023-11-19T00:41:19.306630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'202","last_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_deep_scrub":"75'202","last_deep_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:19.306536+0000","objects_scrubbed":49,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:17.124610+0000","scrub_duration":0.034907383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:06.281328+0000","last_change":"2023-11-19T00:41:06.281350+0000","last_active":"2023-11-19T00:41:06.281328+0000","last_peered":"2023-11-19T00:41:06.281328+0000","last_clean":"2023-11-19T00:41:06.281328+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:41:06.281328+0000","last_undegraded":"2023-11-19T00:41:06.281328+0000","last_fullsized":"2023-11-19T00:41:06.281328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_clean_scrub_stamp":"2023-11-19T00:41:06.281244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:23.140955+0000","scrub_duration":0.0017497389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'163","reported_seq":240,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995676+0000","last_change":"2023-11-19T00:40:25.677431+0000","last_active":"2023-11-19T00:41:00.995676+0000","last_peered":"2023-11-19T00:41:00.995676+0000","last_clean":"2023-11-19T00:41:00.995676+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:41:00.995676+0000","last_undegraded":"2023-11-19T00:41:00.995676+0000","last_fullsized":"2023-11-19T00:41:00.995676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"51'5","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:00.995435+0000","last_change":"2023-11-19T00:40:47.643393+0000","last_active":"2023-11-19T00:41:00.995435+0000","last_peered":"2023-11-19T00:41:00.995435+0000","last_clean":"2023-11-19T00:41:00.995435+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:41:00.995435+0000","last_undegraded":"2023-11-19T00:41:00.995435+0000","last_fullsized":"2023-11-19T00:41:00.995435+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"75'220","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.986982+0000","last_change":"2023-11-19T00:41:15.986982+0000","last_active":"2023-11-19T00:41:15.986982+0000","last_peered":"2023-11-19T00:41:15.986982+0000","last_clean":"2023-11-19T00:41:15.986982+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:41:15.986982+0000","last_undegraded":"2023-11-19T00:41:15.986982+0000","last_fullsized":"2023-11-19T00:41:15.986982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.986886+0000","objects_scrubbed":53,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:40.565603+0000","scrub_duration":0.036034849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"75'7","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:29.949945+0000","last_change":"2023-11-19T00:41:29.949973+0000","last_active":"2023-11-19T00:41:29.949945+0000","last_peered":"2023-11-19T00:41:29.949945+0000","last_clean":"2023-11-19T00:41:29.949945+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:41:29.949945+0000","last_undegraded":"2023-11-19T00:41:29.949945+0000","last_fullsized":"2023-11-19T00:41:29.949945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'7","last_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_deep_scrub":"75'7","last_deep_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_clean_scrub_stamp":"2023-11-19T00:41:29.949858+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:16:37.535582+0000","scrub_duration":0.009494878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"75'207","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.229246+0000","last_change":"2023-11-19T00:42:02.229284+0000","last_active":"2023-11-19T00:42:02.229246+0000","last_peered":"2023-11-19T00:42:02.229246+0000","last_clean":"2023-11-19T00:42:02.229246+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:42:02.229246+0000","last_undegraded":"2023-11-19T00:42:02.229246+0000","last_fullsized":"2023-11-19T00:42:02.229246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.229170+0000","objects_scrubbed":66,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:38.779512+0000","scrub_duration":0.044979045000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443456+0000","last_change":"2023-11-19T00:40:49.650030+0000","last_active":"2023-11-19T00:41:01.443456+0000","last_peered":"2023-11-19T00:41:01.443456+0000","last_clean":"2023-11-19T00:41:01.443456+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:41:01.443456+0000","last_undegraded":"2023-11-19T00:41:01.443456+0000","last_fullsized":"2023-11-19T00:41:01.443456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":214,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443590+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:41:01.443590+0000","last_peered":"2023-11-19T00:41:01.443590+0000","last_clean":"2023-11-19T00:41:01.443590+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:41:01.443590+0000","last_undegraded":"2023-11-19T00:41:01.443590+0000","last_fullsized":"2023-11-19T00:41:01.443590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"75'56","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.925143+0000","last_change":"2023-11-19T00:41:48.925171+0000","last_active":"2023-11-19T00:41:48.925143+0000","last_peered":"2023-11-19T00:41:48.925143+0000","last_clean":"2023-11-19T00:41:48.925143+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:41:48.925143+0000","last_undegraded":"2023-11-19T00:41:48.925143+0000","last_fullsized":"2023-11-19T00:41:48.925143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'56","last_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_deep_scrub":"75'56","last_deep_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.925067+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:26:37.416531+0000","scrub_duration":0.016421860999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"75'228","reported_seq":543,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.083829+0000","last_change":"2023-11-19T00:41:04.083863+0000","last_active":"2023-11-19T00:41:04.083829+0000","last_peered":"2023-11-19T00:41:04.083829+0000","last_clean":"2023-11-19T00:41:04.083829+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:41:04.083829+0000","last_undegraded":"2023-11-19T00:41:04.083829+0000","last_fullsized":"2023-11-19T00:41:04.083829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'228","last_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_deep_scrub":"75'228","last_deep_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.083754+0000","objects_scrubbed":57,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:04:56.786572+0000","scrub_duration":0.039326976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"75'3","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.242942+0000","last_change":"2023-11-19T00:42:13.242967+0000","last_active":"2023-11-19T00:42:13.242942+0000","last_peered":"2023-11-19T00:42:13.242942+0000","last_clean":"2023-11-19T00:42:13.242942+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:42:13.242942+0000","last_undegraded":"2023-11-19T00:42:13.242942+0000","last_fullsized":"2023-11-19T00:42:13.242942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.242851+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:19.880790+0000","scrub_duration":0.0092839810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"75'254","reported_seq":579,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:45.012072+0000","last_change":"2023-11-19T00:41:45.012108+0000","last_active":"2023-11-19T00:41:45.012072+0000","last_peered":"2023-11-19T00:41:45.012072+0000","last_clean":"2023-11-19T00:41:45.012072+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:41:45.012072+0000","last_undegraded":"2023-11-19T00:41:45.012072+0000","last_fullsized":"2023-11-19T00:41:45.012072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'254","last_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_deep_scrub":"75'254","last_deep_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_clean_scrub_stamp":"2023-11-19T00:41:45.011994+0000","objects_scrubbed":64,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:03.705015+0000","scrub_duration":0.043843721000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"75'18","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:11.205693+0000","last_change":"2023-11-19T00:41:11.205737+0000","last_active":"2023-11-19T00:41:11.205693+0000","last_peered":"2023-11-19T00:41:11.205693+0000","last_clean":"2023-11-19T00:41:11.205693+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:41:11.205693+0000","last_undegraded":"2023-11-19T00:41:11.205693+0000","last_fullsized":"2023-11-19T00:41:11.205693+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'18","last_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_deep_scrub":"75'18","last_deep_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_clean_scrub_stamp":"2023-11-19T00:41:11.205579+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:37.711995+0000","scrub_duration":0.010464658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12481,"ondisk_log_size":12481,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":462,"ondisk_log_size":462,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103152,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94268688,"statfs":{"total":96636764160,"available":96531136512,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.186,"5min":0.156,"15min":0.156},"max":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.434},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.60899999999999999,"5min":0.625,"15min":0.625},"last":0.51700000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.59299999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.438,"5min":0.443,"15min":0.45500000000000002},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46200000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110068,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94261772,"statfs":{"total":96636764160,"available":96524054528,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.27100000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.47599999999999998},"min":{"1min":0.255,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.40000000000000002}]},{"osd":1,"last update":"Sun Nov 19 00:41:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.46899999999999997},"min":{"1min":0.21299999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60699999999999998,"5min":0.63,"15min":0.63},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.46600000000000003},"min":{"1min":0.26200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.45300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100804,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94271036,"statfs":{"total":96636764160,"available":96533540864,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.44,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.625},"last":0.42099999999999999}]},{"osd":2,"last update":"Sun Nov 19 00:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.29899999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.39200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:42:23.166 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.166 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.167 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.167 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.167 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.167 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.167 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.168 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.168 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.168 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.168 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.169 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.169 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.169 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.169 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.169 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.170 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.170 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.170 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.170 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.170 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.171 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.171 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.171 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.171 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.171 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.172 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.172 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.172 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.172 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.172 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:23.173 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-19T00:42:43.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:42:43.485 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:42:43.486 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:42:43.496 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-11-19T00:42:43.075344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13801,"ondisk_log_size":13801,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":318184,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":164283,"kb_avail":282797336,"statfs":{"total":289910292480,"available":289584472064,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":168226127},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003319"},"pg_stats":[{"pgid":"4.3f","version":"75'215","reported_seq":511,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.015170+0000","last_change":"2023-11-19T00:41:12.015195+0000","last_active":"2023-11-19T00:41:12.015170+0000","last_peered":"2023-11-19T00:41:12.015170+0000","last_clean":"2023-11-19T00:41:12.015170+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:41:12.015170+0000","last_undegraded":"2023-11-19T00:41:12.015170+0000","last_fullsized":"2023-11-19T00:41:12.015170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.015097+0000","objects_scrubbed":50,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:27.053797+0000","scrub_duration":0.036690850999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"75'207","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:04.947403+0000","last_change":"2023-11-19T00:42:04.947449+0000","last_active":"2023-11-19T00:42:04.947403+0000","last_peered":"2023-11-19T00:42:04.947403+0000","last_clean":"2023-11-19T00:42:04.947403+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:42:04.947403+0000","last_undegraded":"2023-11-19T00:42:04.947403+0000","last_fullsized":"2023-11-19T00:42:04.947403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_clean_scrub_stamp":"2023-11-19T00:42:04.947330+0000","objects_scrubbed":45,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:45:23.142624+0000","scrub_duration":0.031262616999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"75'207","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.223196+0000","last_change":"2023-11-19T00:42:13.223244+0000","last_active":"2023-11-19T00:42:13.223196+0000","last_peered":"2023-11-19T00:42:13.223196+0000","last_clean":"2023-11-19T00:42:13.223196+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:42:13.223196+0000","last_undegraded":"2023-11-19T00:42:13.223196+0000","last_fullsized":"2023-11-19T00:42:13.223196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.223119+0000","objects_scrubbed":39,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:01:18.136942+0000","scrub_duration":0.027099018999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"75'172","reported_seq":232,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:10.950084+0000","last_change":"2023-11-19T00:41:10.950107+0000","last_active":"2023-11-19T00:41:10.950084+0000","last_peered":"2023-11-19T00:41:10.950084+0000","last_clean":"2023-11-19T00:41:10.950084+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:41:10.950084+0000","last_undegraded":"2023-11-19T00:41:10.950084+0000","last_fullsized":"2023-11-19T00:41:10.950084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'172","last_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_deep_scrub":"75'172","last_deep_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_clean_scrub_stamp":"2023-11-19T00:41:10.950010+0000","objects_scrubbed":51,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:03.687754+0000","scrub_duration":0.034903271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'171","reported_seq":498,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629503+0000","last_change":"2023-11-19T00:40:50.632170+0000","last_active":"2023-11-19T00:40:51.629503+0000","last_peered":"2023-11-19T00:40:51.629503+0000","last_clean":"2023-11-19T00:40:51.629503+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:40:51.629503+0000","last_undegraded":"2023-11-19T00:40:51.629503+0000","last_fullsized":"2023-11-19T00:40:51.629503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"75'221","reported_seq":519,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:29.297602+0000","last_change":"2023-11-19T00:42:29.297650+0000","last_active":"2023-11-19T00:42:29.297602+0000","last_peered":"2023-11-19T00:42:29.297602+0000","last_clean":"2023-11-19T00:42:29.297602+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:42:29.297602+0000","last_undegraded":"2023-11-19T00:42:29.297602+0000","last_fullsized":"2023-11-19T00:42:29.297602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:42:29.297503+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:42:29.297503+0000","last_clean_scrub_stamp":"2023-11-19T00:42:29.297503+0000","objects_scrubbed":55,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:50:20.920428+0000","scrub_duration":0.039328285999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"75'227","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:41.910516+0000","last_change":"2023-11-19T00:41:41.910554+0000","last_active":"2023-11-19T00:41:41.910516+0000","last_peered":"2023-11-19T00:41:41.910516+0000","last_clean":"2023-11-19T00:41:41.910516+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:41:41.910516+0000","last_undegraded":"2023-11-19T00:41:41.910516+0000","last_fullsized":"2023-11-19T00:41:41.910516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'227","last_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_deep_scrub":"75'227","last_deep_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_clean_scrub_stamp":"2023-11-19T00:41:41.910446+0000","objects_scrubbed":62,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:52.519112+0000","scrub_duration":0.043757361000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"75'179","reported_seq":426,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.949857+0000","last_change":"2023-11-19T00:41:36.949897+0000","last_active":"2023-11-19T00:41:36.949857+0000","last_peered":"2023-11-19T00:41:36.949857+0000","last_clean":"2023-11-19T00:41:36.949857+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:41:36.949857+0000","last_undegraded":"2023-11-19T00:41:36.949857+0000","last_fullsized":"2023-11-19T00:41:36.949857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'179","last_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_deep_scrub":"75'179","last_deep_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.949768+0000","objects_scrubbed":48,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:32.130529+0000","scrub_duration":0.033692611999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.238253+0000","last_change":"2023-11-19T00:41:08.238253+0000","last_active":"2023-11-19T00:41:08.238253+0000","last_peered":"2023-11-19T00:41:08.238253+0000","last_clean":"2023-11-19T00:41:08.238253+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:41:08.238253+0000","last_undegraded":"2023-11-19T00:41:08.238253+0000","last_fullsized":"2023-11-19T00:41:08.238253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.238154+0000","objects_scrubbed":51,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:28:28.657653+0000","scrub_duration":0.035756160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"75'197","reported_seq":470,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:40.870526+0000","last_change":"2023-11-19T00:42:40.870564+0000","last_active":"2023-11-19T00:42:40.870526+0000","last_peered":"2023-11-19T00:42:40.870526+0000","last_clean":"2023-11-19T00:42:40.870526+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:42:40.870526+0000","last_undegraded":"2023-11-19T00:42:40.870526+0000","last_fullsized":"2023-11-19T00:42:40.870526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'197","last_scrub_stamp":"2023-11-19T00:42:40.870444+0000","last_deep_scrub":"75'197","last_deep_scrub_stamp":"2023-11-19T00:42:40.870444+0000","last_clean_scrub_stamp":"2023-11-19T00:42:40.870444+0000","objects_scrubbed":49,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:58:51.479110+0000","scrub_duration":0.031404438999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"75'215","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.969246+0000","last_change":"2023-11-19T00:41:15.969271+0000","last_active":"2023-11-19T00:41:15.969246+0000","last_peered":"2023-11-19T00:41:15.969246+0000","last_clean":"2023-11-19T00:41:15.969246+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:41:15.969246+0000","last_undegraded":"2023-11-19T00:41:15.969246+0000","last_fullsized":"2023-11-19T00:41:15.969246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.969180+0000","objects_scrubbed":56,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:37:03.160511+0000","scrub_duration":0.046149739000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"75'191","reported_seq":277,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.898049+0000","last_change":"2023-11-19T00:42:20.898107+0000","last_active":"2023-11-19T00:42:20.898049+0000","last_peered":"2023-11-19T00:42:20.898049+0000","last_clean":"2023-11-19T00:42:20.898049+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:42:20.898049+0000","last_undegraded":"2023-11-19T00:42:20.898049+0000","last_fullsized":"2023-11-19T00:42:20.898049+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'191","last_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_deep_scrub":"75'191","last_deep_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.897961+0000","objects_scrubbed":55,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:41.542056+0000","scrub_duration":0.041092573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"75'183","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:09.037090+0000","last_change":"2023-11-19T00:41:09.037113+0000","last_active":"2023-11-19T00:41:09.037090+0000","last_peered":"2023-11-19T00:41:09.037090+0000","last_clean":"2023-11-19T00:41:09.037090+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:41:09.037090+0000","last_undegraded":"2023-11-19T00:41:09.037090+0000","last_fullsized":"2023-11-19T00:41:09.037090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'183","last_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_deep_scrub":"75'183","last_deep_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_clean_scrub_stamp":"2023-11-19T00:41:09.037014+0000","objects_scrubbed":50,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:26.814001+0000","scrub_duration":0.033302804999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"75'224","reported_seq":724,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:52.995941+0000","last_change":"2023-11-19T00:41:52.995980+0000","last_active":"2023-11-19T00:41:52.995941+0000","last_peered":"2023-11-19T00:41:52.995941+0000","last_clean":"2023-11-19T00:41:52.995941+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:41:52.995941+0000","last_undegraded":"2023-11-19T00:41:52.995941+0000","last_fullsized":"2023-11-19T00:41:52.995941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'224","last_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_deep_scrub":"75'224","last_deep_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_clean_scrub_stamp":"2023-11-19T00:41:52.995854+0000","objects_scrubbed":44,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:27.412450+0000","scrub_duration":0.030047951999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"75'206","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.250517+0000","last_change":"2023-11-19T00:42:07.250542+0000","last_active":"2023-11-19T00:42:07.250517+0000","last_peered":"2023-11-19T00:42:07.250517+0000","last_clean":"2023-11-19T00:42:07.250517+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:42:07.250517+0000","last_undegraded":"2023-11-19T00:42:07.250517+0000","last_fullsized":"2023-11-19T00:42:07.250517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.250444+0000","objects_scrubbed":50,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:41:30.400474+0000","scrub_duration":0.034619200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'231","reported_seq":298,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:51.008109+0000","last_change":"2023-11-19T00:41:51.008143+0000","last_active":"2023-11-19T00:41:51.008109+0000","last_peered":"2023-11-19T00:41:51.008109+0000","last_clean":"2023-11-19T00:41:51.008109+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:41:51.008109+0000","last_undegraded":"2023-11-19T00:41:51.008109+0000","last_fullsized":"2023-11-19T00:41:51.008109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_clean_scrub_stamp":"2023-11-19T00:41:51.008026+0000","objects_scrubbed":58,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:38.626133+0000","scrub_duration":0.041732172999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"75'207","reported_seq":286,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.461743+0000","last_change":"2023-11-19T00:41:48.461784+0000","last_active":"2023-11-19T00:41:48.461743+0000","last_peered":"2023-11-19T00:41:48.461743+0000","last_clean":"2023-11-19T00:41:48.461743+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:41:48.461743+0000","last_undegraded":"2023-11-19T00:41:48.461743+0000","last_fullsized":"2023-11-19T00:41:48.461743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.461644+0000","objects_scrubbed":53,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:30:42.739782+0000","scrub_duration":0.045335093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"75'199","reported_seq":483,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.090823+0000","last_change":"2023-11-19T00:41:03.090862+0000","last_active":"2023-11-19T00:41:03.090823+0000","last_peered":"2023-11-19T00:41:03.090823+0000","last_clean":"2023-11-19T00:41:03.090823+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:41:03.090823+0000","last_undegraded":"2023-11-19T00:41:03.090823+0000","last_fullsized":"2023-11-19T00:41:03.090823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.090716+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:42.528537+0000","scrub_duration":0.045074112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"75'196","reported_seq":478,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:33.311076+0000","last_change":"2023-11-19T00:42:33.311118+0000","last_active":"2023-11-19T00:42:33.311076+0000","last_peered":"2023-11-19T00:42:33.311076+0000","last_clean":"2023-11-19T00:42:33.311076+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:42:33.311076+0000","last_undegraded":"2023-11-19T00:42:33.311076+0000","last_fullsized":"2023-11-19T00:42:33.311076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'196","last_scrub_stamp":"2023-11-19T00:42:33.310988+0000","last_deep_scrub":"75'196","last_deep_scrub_stamp":"2023-11-19T00:42:33.310988+0000","last_clean_scrub_stamp":"2023-11-19T00:42:33.310988+0000","objects_scrubbed":51,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:20.855882+0000","scrub_duration":0.041832331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"75'221","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.963592+0000","last_change":"2023-11-19T00:41:04.963623+0000","last_active":"2023-11-19T00:41:04.963592+0000","last_peered":"2023-11-19T00:41:04.963592+0000","last_clean":"2023-11-19T00:41:04.963592+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:41:04.963592+0000","last_undegraded":"2023-11-19T00:41:04.963592+0000","last_fullsized":"2023-11-19T00:41:04.963592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.963516+0000","objects_scrubbed":56,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:06.799626+0000","scrub_duration":0.039865746000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"75'217","reported_seq":275,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.942577+0000","last_change":"2023-11-19T00:41:12.942606+0000","last_active":"2023-11-19T00:41:12.942577+0000","last_peered":"2023-11-19T00:41:12.942577+0000","last_clean":"2023-11-19T00:41:12.942577+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:41:12.942577+0000","last_undegraded":"2023-11-19T00:41:12.942577+0000","last_fullsized":"2023-11-19T00:41:12.942577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'217","last_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_deep_scrub":"75'217","last_deep_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.942504+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:29.802215+0000","scrub_duration":0.042793523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:10.027915+0000","last_change":"2023-11-19T00:42:10.027942+0000","last_active":"2023-11-19T00:42:10.027915+0000","last_peered":"2023-11-19T00:42:10.027915+0000","last_clean":"2023-11-19T00:42:10.027915+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:42:10.027915+0000","last_undegraded":"2023-11-19T00:42:10.027915+0000","last_fullsized":"2023-11-19T00:42:10.027915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_clean_scrub_stamp":"2023-11-19T00:42:10.027812+0000","objects_scrubbed":54,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:40.543546+0000","scrub_duration":0.042942501000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"75'211","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.392748+0000","last_change":"2023-11-19T00:41:42.392777+0000","last_active":"2023-11-19T00:41:42.392748+0000","last_peered":"2023-11-19T00:41:42.392748+0000","last_clean":"2023-11-19T00:41:42.392748+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:41:42.392748+0000","last_undegraded":"2023-11-19T00:41:42.392748+0000","last_fullsized":"2023-11-19T00:41:42.392748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.392663+0000","objects_scrubbed":60,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:23.806495+0000","scrub_duration":0.040785126999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"75'212","reported_seq":276,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:36.921953+0000","last_change":"2023-11-19T00:42:36.921989+0000","last_active":"2023-11-19T00:42:36.921953+0000","last_peered":"2023-11-19T00:42:36.921953+0000","last_clean":"2023-11-19T00:42:36.921953+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:42:36.921953+0000","last_undegraded":"2023-11-19T00:42:36.921953+0000","last_fullsized":"2023-11-19T00:42:36.921953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'212","last_scrub_stamp":"2023-11-19T00:42:36.921879+0000","last_deep_scrub":"75'212","last_deep_scrub_stamp":"2023-11-19T00:42:36.921879+0000","last_clean_scrub_stamp":"2023-11-19T00:42:36.921879+0000","objects_scrubbed":49,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:17:25.597966+0000","scrub_duration":0.031590009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"75'213","reported_seq":312,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.956972+0000","last_change":"2023-11-19T00:41:26.957022+0000","last_active":"2023-11-19T00:41:26.956972+0000","last_peered":"2023-11-19T00:41:26.956972+0000","last_clean":"2023-11-19T00:41:26.956972+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:41:26.956972+0000","last_undegraded":"2023-11-19T00:41:26.956972+0000","last_fullsized":"2023-11-19T00:41:26.956972+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.956876+0000","objects_scrubbed":53,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:31:00.258795+0000","scrub_duration":0.041573285000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"75'246","reported_seq":325,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:30.252873+0000","last_change":"2023-11-19T00:41:30.252904+0000","last_active":"2023-11-19T00:41:30.252873+0000","last_peered":"2023-11-19T00:41:30.252873+0000","last_clean":"2023-11-19T00:41:30.252873+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:41:30.252873+0000","last_undegraded":"2023-11-19T00:41:30.252873+0000","last_fullsized":"2023-11-19T00:41:30.252873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'246","last_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_deep_scrub":"75'246","last_deep_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_clean_scrub_stamp":"2023-11-19T00:41:30.252803+0000","objects_scrubbed":61,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:05:30.610485+0000","scrub_duration":0.045754178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"75'200","reported_seq":283,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.237889+0000","last_change":"2023-11-19T00:42:15.237917+0000","last_active":"2023-11-19T00:42:15.237889+0000","last_peered":"2023-11-19T00:42:15.237889+0000","last_clean":"2023-11-19T00:42:15.237889+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:42:15.237889+0000","last_undegraded":"2023-11-19T00:42:15.237889+0000","last_fullsized":"2023-11-19T00:42:15.237889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.237806+0000","objects_scrubbed":52,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:11:37.875363+0000","scrub_duration":0.035472484999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"75'195","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:14.991821+0000","last_change":"2023-11-19T00:41:14.991861+0000","last_active":"2023-11-19T00:41:14.991821+0000","last_peered":"2023-11-19T00:41:14.991821+0000","last_clean":"2023-11-19T00:41:14.991821+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:41:14.991821+0000","last_undegraded":"2023-11-19T00:41:14.991821+0000","last_fullsized":"2023-11-19T00:41:14.991821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'195","last_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_deep_scrub":"75'195","last_deep_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_clean_scrub_stamp":"2023-11-19T00:41:14.991747+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:33.385240+0000","scrub_duration":0.031971732000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"60'160","reported_seq":669,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:53.633329+0000","last_change":"2023-11-19T00:40:50.631589+0000","last_active":"2023-11-19T00:40:53.633329+0000","last_peered":"2023-11-19T00:40:53.633329+0000","last_clean":"2023-11-19T00:40:53.633329+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:40:53.633329+0000","last_undegraded":"2023-11-19T00:40:53.633329+0000","last_fullsized":"2023-11-19T00:40:53.633329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"75'253","reported_seq":342,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:29.855701+0000","last_change":"2023-11-19T00:42:29.855731+0000","last_active":"2023-11-19T00:42:29.855701+0000","last_peered":"2023-11-19T00:42:29.855701+0000","last_clean":"2023-11-19T00:42:29.855701+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:42:29.855701+0000","last_undegraded":"2023-11-19T00:42:29.855701+0000","last_fullsized":"2023-11-19T00:42:29.855701+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'253","last_scrub_stamp":"2023-11-19T00:42:29.855630+0000","last_deep_scrub":"75'253","last_deep_scrub_stamp":"2023-11-19T00:42:29.855630+0000","last_clean_scrub_stamp":"2023-11-19T00:42:29.855630+0000","objects_scrubbed":64,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:46.808688+0000","scrub_duration":0.046923685999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"75'255","reported_seq":842,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:34.351725+0000","last_change":"2023-11-19T00:42:34.351762+0000","last_active":"2023-11-19T00:42:34.351725+0000","last_peered":"2023-11-19T00:42:34.351725+0000","last_clean":"2023-11-19T00:42:34.351725+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:42:34.351725+0000","last_undegraded":"2023-11-19T00:42:34.351725+0000","last_fullsized":"2023-11-19T00:42:34.351725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'255","last_scrub_stamp":"2023-11-19T00:42:34.351651+0000","last_deep_scrub":"75'255","last_deep_scrub_stamp":"2023-11-19T00:42:34.351651+0000","last_clean_scrub_stamp":"2023-11-19T00:42:34.351651+0000","objects_scrubbed":61,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:28:06.035302+0000","scrub_duration":0.041563124999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"75'234","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.033187+0000","last_change":"2023-11-19T00:41:55.033234+0000","last_active":"2023-11-19T00:41:55.033187+0000","last_peered":"2023-11-19T00:41:55.033187+0000","last_clean":"2023-11-19T00:41:55.033187+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:41:55.033187+0000","last_undegraded":"2023-11-19T00:41:55.033187+0000","last_fullsized":"2023-11-19T00:41:55.033187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'234","last_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_deep_scrub":"75'234","last_deep_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.033097+0000","objects_scrubbed":50,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:01.427989+0000","scrub_duration":0.036056435999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'138","reported_seq":404,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:51.629535+0000","last_change":"2023-11-19T00:40:50.631655+0000","last_active":"2023-11-19T00:40:51.629535+0000","last_peered":"2023-11-19T00:40:51.629535+0000","last_clean":"2023-11-19T00:40:51.629535+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:40:51.629535+0000","last_undegraded":"2023-11-19T00:40:51.629535+0000","last_fullsized":"2023-11-19T00:40:51.629535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'140","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.861697+0000","last_change":"2023-11-19T00:41:08.861726+0000","last_active":"2023-11-19T00:41:08.861697+0000","last_peered":"2023-11-19T00:41:08.861697+0000","last_clean":"2023-11-19T00:41:08.861697+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:41:08.861697+0000","last_undegraded":"2023-11-19T00:41:08.861697+0000","last_fullsized":"2023-11-19T00:41:08.861697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'140","last_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_deep_scrub":"75'140","last_deep_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.861626+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:02.346222+0000","scrub_duration":0.0096612360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"59'197","reported_seq":473,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629510+0000","last_change":"2023-11-19T00:40:49.632295+0000","last_active":"2023-11-19T00:40:50.629510+0000","last_peered":"2023-11-19T00:40:50.629510+0000","last_clean":"2023-11-19T00:40:50.629510+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:40:50.629510+0000","last_undegraded":"2023-11-19T00:40:50.629510+0000","last_fullsized":"2023-11-19T00:40:50.629510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:58.324049+0000","last_change":"2023-11-19T00:41:58.324092+0000","last_active":"2023-11-19T00:41:58.324049+0000","last_peered":"2023-11-19T00:41:58.324049+0000","last_clean":"2023-11-19T00:41:58.324049+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:41:58.324049+0000","last_undegraded":"2023-11-19T00:41:58.324049+0000","last_fullsized":"2023-11-19T00:41:58.324049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_clean_scrub_stamp":"2023-11-19T00:41:58.323959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:04.718851+0000","scrub_duration":0.0018957519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'236","reported_seq":315,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:53.485524+0000","last_change":"2023-11-19T00:41:53.485557+0000","last_active":"2023-11-19T00:41:53.485524+0000","last_peered":"2023-11-19T00:41:53.485524+0000","last_clean":"2023-11-19T00:41:53.485524+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:41:53.485524+0000","last_undegraded":"2023-11-19T00:41:53.485524+0000","last_fullsized":"2023-11-19T00:41:53.485524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'236","last_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_deep_scrub":"75'236","last_deep_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_clean_scrub_stamp":"2023-11-19T00:41:53.485439+0000","objects_scrubbed":63,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:20.013886+0000","scrub_duration":0.043385156000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:19.896895+0000","last_change":"2023-11-19T00:42:19.896917+0000","last_active":"2023-11-19T00:42:19.896895+0000","last_peered":"2023-11-19T00:42:19.896895+0000","last_clean":"2023-11-19T00:42:19.896895+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:42:19.896895+0000","last_undegraded":"2023-11-19T00:42:19.896895+0000","last_fullsized":"2023-11-19T00:42:19.896895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_clean_scrub_stamp":"2023-11-19T00:42:19.896803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:36:46.403219+0000","scrub_duration":0.0019930909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"75'206","reported_seq":274,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.456295+0000","last_change":"2023-11-19T00:41:50.456322+0000","last_active":"2023-11-19T00:41:50.456295+0000","last_peered":"2023-11-19T00:41:50.456295+0000","last_clean":"2023-11-19T00:41:50.456295+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:41:50.456295+0000","last_undegraded":"2023-11-19T00:41:50.456295+0000","last_fullsized":"2023-11-19T00:41:50.456295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.456210+0000","objects_scrubbed":54,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:50:56.340582+0000","scrub_duration":0.037720240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"75'12","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:17.957067+0000","last_change":"2023-11-19T00:41:17.957098+0000","last_active":"2023-11-19T00:41:17.957067+0000","last_peered":"2023-11-19T00:41:17.957067+0000","last_clean":"2023-11-19T00:41:17.957067+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:41:17.957067+0000","last_undegraded":"2023-11-19T00:41:17.957067+0000","last_fullsized":"2023-11-19T00:41:17.957067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_clean_scrub_stamp":"2023-11-19T00:41:17.956986+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:03:50.209311+0000","scrub_duration":0.0041360729999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"75'2","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.876155+0000","last_change":"2023-11-19T00:41:39.876223+0000","last_active":"2023-11-19T00:41:39.876155+0000","last_peered":"2023-11-19T00:41:39.876155+0000","last_clean":"2023-11-19T00:41:39.876155+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:41:39.876155+0000","last_undegraded":"2023-11-19T00:41:39.876155+0000","last_fullsized":"2023-11-19T00:41:39.876155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.876064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:21.289896+0000","scrub_duration":0.0035587930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"75'211","reported_seq":300,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.930138+0000","last_change":"2023-11-19T00:42:15.930166+0000","last_active":"2023-11-19T00:42:15.930138+0000","last_peered":"2023-11-19T00:42:15.930138+0000","last_clean":"2023-11-19T00:42:15.930138+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:42:15.930138+0000","last_undegraded":"2023-11-19T00:42:15.930138+0000","last_fullsized":"2023-11-19T00:42:15.930138+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.930063+0000","objects_scrubbed":52,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:39:54.200236+0000","scrub_duration":0.037878510999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"75'4","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.934069+0000","last_change":"2023-11-19T00:42:05.934099+0000","last_active":"2023-11-19T00:42:05.934069+0000","last_peered":"2023-11-19T00:42:05.934069+0000","last_clean":"2023-11-19T00:42:05.934069+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:42:05.934069+0000","last_undegraded":"2023-11-19T00:42:05.934069+0000","last_fullsized":"2023-11-19T00:42:05.934069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.933982+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:00:07.479529+0000","scrub_duration":0.0031029730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"75'225","reported_seq":540,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.058756+0000","last_change":"2023-11-19T00:41:42.058808+0000","last_active":"2023-11-19T00:41:42.058756+0000","last_peered":"2023-11-19T00:41:42.058756+0000","last_clean":"2023-11-19T00:41:42.058756+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:41:42.058756+0000","last_undegraded":"2023-11-19T00:41:42.058756+0000","last_fullsized":"2023-11-19T00:41:42.058756+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'225","last_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_deep_scrub":"75'225","last_deep_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.058668+0000","objects_scrubbed":58,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:08.830501+0000","scrub_duration":0.041143718000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"75'3","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:21.189979+0000","last_change":"2023-11-19T00:42:21.190005+0000","last_active":"2023-11-19T00:42:21.189979+0000","last_peered":"2023-11-19T00:42:21.189979+0000","last_clean":"2023-11-19T00:42:21.189979+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:42:21.189979+0000","last_undegraded":"2023-11-19T00:42:21.189979+0000","last_fullsized":"2023-11-19T00:42:21.189979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_clean_scrub_stamp":"2023-11-19T00:42:21.189891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:08.734785+0000","scrub_duration":0.0034598979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"75'201","reported_seq":481,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.932131+0000","last_change":"2023-11-19T00:41:07.932168+0000","last_active":"2023-11-19T00:41:07.932131+0000","last_peered":"2023-11-19T00:41:07.932131+0000","last_clean":"2023-11-19T00:41:07.932131+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:41:07.932131+0000","last_undegraded":"2023-11-19T00:41:07.932131+0000","last_fullsized":"2023-11-19T00:41:07.932131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'201","last_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_deep_scrub":"75'201","last_deep_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.932043+0000","objects_scrubbed":56,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:52:53.830915+0000","scrub_duration":0.040909213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:37.263559+0000","last_change":"2023-11-19T00:42:37.263593+0000","last_active":"2023-11-19T00:42:37.263559+0000","last_peered":"2023-11-19T00:42:37.263559+0000","last_clean":"2023-11-19T00:42:37.263559+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:42:37.263559+0000","last_undegraded":"2023-11-19T00:42:37.263559+0000","last_fullsized":"2023-11-19T00:42:37.263559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'2","last_scrub_stamp":"2023-11-19T00:42:37.263440+0000","last_deep_scrub":"51'2","last_deep_scrub_stamp":"2023-11-19T00:42:37.263440+0000","last_clean_scrub_stamp":"2023-11-19T00:42:37.263440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:39:37.303438+0000","scrub_duration":0.002021194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"75'214","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:30.325146+0000","last_change":"2023-11-19T00:42:30.325172+0000","last_active":"2023-11-19T00:42:30.325146+0000","last_peered":"2023-11-19T00:42:30.325146+0000","last_clean":"2023-11-19T00:42:30.325146+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:42:30.325146+0000","last_undegraded":"2023-11-19T00:42:30.325146+0000","last_fullsized":"2023-11-19T00:42:30.325146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'214","last_scrub_stamp":"2023-11-19T00:42:30.325071+0000","last_deep_scrub":"75'214","last_deep_scrub_stamp":"2023-11-19T00:42:30.325071+0000","last_clean_scrub_stamp":"2023-11-19T00:42:30.325071+0000","objects_scrubbed":54,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:00:24.833086+0000","scrub_duration":0.034972046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"75'24","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.195410+0000","last_change":"2023-11-19T00:41:26.195438+0000","last_active":"2023-11-19T00:41:26.195410+0000","last_peered":"2023-11-19T00:41:26.195410+0000","last_clean":"2023-11-19T00:41:26.195410+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:41:26.195410+0000","last_undegraded":"2023-11-19T00:41:26.195410+0000","last_fullsized":"2023-11-19T00:41:26.195410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'24","last_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_deep_scrub":"75'24","last_deep_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.195316+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:42.215791+0000","scrub_duration":0.010042868999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"75'237","reported_seq":550,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:31.880355+0000","last_change":"2023-11-19T00:41:31.880416+0000","last_active":"2023-11-19T00:41:31.880355+0000","last_peered":"2023-11-19T00:41:31.880355+0000","last_clean":"2023-11-19T00:41:31.880355+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:41:31.880355+0000","last_undegraded":"2023-11-19T00:41:31.880355+0000","last_fullsized":"2023-11-19T00:41:31.880355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'237","last_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_deep_scrub":"75'237","last_deep_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_clean_scrub_stamp":"2023-11-19T00:41:31.880270+0000","objects_scrubbed":63,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:45:07.860358+0000","scrub_duration":0.045259584999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:56.632301+0000","last_change":"2023-11-19T00:40:49.649723+0000","last_active":"2023-11-19T00:40:56.632301+0000","last_peered":"2023-11-19T00:40:56.632301+0000","last_clean":"2023-11-19T00:40:56.632301+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:40:56.632301+0000","last_undegraded":"2023-11-19T00:40:56.632301+0000","last_fullsized":"2023-11-19T00:40:56.632301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:42.752781+0000","last_clean_scrub_stamp":"2023-11-19T00:38:42.752781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"75'220","reported_seq":303,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.223699+0000","last_change":"2023-11-19T00:42:17.223729+0000","last_active":"2023-11-19T00:42:17.223699+0000","last_peered":"2023-11-19T00:42:17.223699+0000","last_clean":"2023-11-19T00:42:17.223699+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:42:17.223699+0000","last_undegraded":"2023-11-19T00:42:17.223699+0000","last_fullsized":"2023-11-19T00:42:17.223699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.223626+0000","objects_scrubbed":60,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:53.070995+0000","scrub_duration":0.040470229000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:28.830332+0000","last_change":"2023-11-19T00:42:28.830355+0000","last_active":"2023-11-19T00:42:28.830332+0000","last_peered":"2023-11-19T00:42:28.830332+0000","last_clean":"2023-11-19T00:42:28.830332+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:42:28.830332+0000","last_undegraded":"2023-11-19T00:42:28.830332+0000","last_fullsized":"2023-11-19T00:42:28.830332+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:42:28.830245+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:42:28.830245+0000","last_clean_scrub_stamp":"2023-11-19T00:42:28.830245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:19.916978+0000","scrub_duration":0.001594212,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"75'186","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.036628+0000","last_change":"2023-11-19T00:41:50.036692+0000","last_active":"2023-11-19T00:41:50.036628+0000","last_peered":"2023-11-19T00:41:50.036628+0000","last_clean":"2023-11-19T00:41:50.036628+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:41:50.036628+0000","last_undegraded":"2023-11-19T00:41:50.036628+0000","last_fullsized":"2023-11-19T00:41:50.036628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.036536+0000","objects_scrubbed":49,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:16.564983+0000","scrub_duration":0.040848061999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:35.937061+0000","last_change":"2023-11-19T00:42:35.937090+0000","last_active":"2023-11-19T00:42:35.937061+0000","last_peered":"2023-11-19T00:42:35.937061+0000","last_clean":"2023-11-19T00:42:35.937061+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:42:35.937061+0000","last_undegraded":"2023-11-19T00:42:35.937061+0000","last_fullsized":"2023-11-19T00:42:35.937061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'1","last_scrub_stamp":"2023-11-19T00:42:35.936973+0000","last_deep_scrub":"47'1","last_deep_scrub_stamp":"2023-11-19T00:42:35.936973+0000","last_clean_scrub_stamp":"2023-11-19T00:42:35.936973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:07:24.029638+0000","scrub_duration":0.001736455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"75'193","reported_seq":272,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.356161+0000","last_change":"2023-11-19T00:41:36.356189+0000","last_active":"2023-11-19T00:41:36.356161+0000","last_peered":"2023-11-19T00:41:36.356161+0000","last_clean":"2023-11-19T00:41:36.356161+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:41:36.356161+0000","last_undegraded":"2023-11-19T00:41:36.356161+0000","last_fullsized":"2023-11-19T00:41:36.356161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'193","last_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_deep_scrub":"75'193","last_deep_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.356083+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:24.448748+0000","scrub_duration":0.035468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"75'159","reported_seq":318,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:00.102757+0000","last_change":"2023-11-19T00:42:00.102757+0000","last_active":"2023-11-19T00:42:00.102757+0000","last_peered":"2023-11-19T00:42:00.102757+0000","last_clean":"2023-11-19T00:42:00.102757+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:42:00.102757+0000","last_undegraded":"2023-11-19T00:42:00.102757+0000","last_fullsized":"2023-11-19T00:42:00.102757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'159","last_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_deep_scrub":"75'159","last_deep_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_clean_scrub_stamp":"2023-11-19T00:42:00.102649+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:42.477629+0000","scrub_duration":0.0046503730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:40.256181+0000","last_change":"2023-11-19T00:42:40.256201+0000","last_active":"2023-11-19T00:42:40.256181+0000","last_peered":"2023-11-19T00:42:40.256181+0000","last_clean":"2023-11-19T00:42:40.256181+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:42:40.256181+0000","last_undegraded":"2023-11-19T00:42:40.256181+0000","last_fullsized":"2023-11-19T00:42:40.256181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:40.256102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:40.256102+0000","last_clean_scrub_stamp":"2023-11-19T00:42:40.256102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:08.896709+0000","scrub_duration":0.0019289000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.188035+0000","last_change":"2023-11-19T00:42:20.188057+0000","last_active":"2023-11-19T00:42:20.188035+0000","last_peered":"2023-11-19T00:42:20.188035+0000","last_clean":"2023-11-19T00:42:20.188035+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:42:20.188035+0000","last_undegraded":"2023-11-19T00:42:20.188035+0000","last_fullsized":"2023-11-19T00:42:20.188035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'1","last_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_deep_scrub":"43'1","last_deep_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.187953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:45.835355+0000","scrub_duration":0.0019880190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"75'199","reported_seq":498,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:26.278198+0000","last_change":"2023-11-19T00:42:26.278230+0000","last_active":"2023-11-19T00:42:26.278198+0000","last_peered":"2023-11-19T00:42:26.278198+0000","last_clean":"2023-11-19T00:42:26.278198+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:42:26.278198+0000","last_undegraded":"2023-11-19T00:42:26.278198+0000","last_fullsized":"2023-11-19T00:42:26.278198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:42:26.278125+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:42:26.278125+0000","last_clean_scrub_stamp":"2023-11-19T00:42:26.278125+0000","objects_scrubbed":60,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:16:35.526070+0000","scrub_duration":0.040067627000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.198576+0000","last_change":"2023-11-19T00:42:05.198576+0000","last_active":"2023-11-19T00:42:05.198576+0000","last_peered":"2023-11-19T00:42:05.198576+0000","last_clean":"2023-11-19T00:42:05.198576+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:42:05.198576+0000","last_undegraded":"2023-11-19T00:42:05.198576+0000","last_fullsized":"2023-11-19T00:42:05.198576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.198443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:02.651958+0000","scrub_duration":0.0016848690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"75'35","reported_seq":146,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:57.368468+0000","last_change":"2023-11-19T00:41:57.368492+0000","last_active":"2023-11-19T00:41:57.368468+0000","last_peered":"2023-11-19T00:41:57.368468+0000","last_clean":"2023-11-19T00:41:57.368468+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:41:57.368468+0000","last_undegraded":"2023-11-19T00:41:57.368468+0000","last_fullsized":"2023-11-19T00:41:57.368468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'35","last_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_deep_scrub":"75'35","last_deep_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_clean_scrub_stamp":"2023-11-19T00:41:57.368388+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:31.784985+0000","scrub_duration":0.0040954440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"75'208","reported_seq":718,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.122122+0000","last_change":"2023-11-19T00:41:07.122147+0000","last_active":"2023-11-19T00:41:07.122122+0000","last_peered":"2023-11-19T00:41:07.122122+0000","last_clean":"2023-11-19T00:41:07.122122+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:41:07.122122+0000","last_undegraded":"2023-11-19T00:41:07.122122+0000","last_fullsized":"2023-11-19T00:41:07.122122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'208","last_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_deep_scrub":"75'208","last_deep_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.122048+0000","objects_scrubbed":53,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:15.227402+0000","scrub_duration":0.037815080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.379460+0000","last_change":"2023-11-19T00:41:55.379498+0000","last_active":"2023-11-19T00:41:55.379460+0000","last_peered":"2023-11-19T00:41:55.379460+0000","last_clean":"2023-11-19T00:41:55.379460+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:41:55.379460+0000","last_undegraded":"2023-11-19T00:41:55.379460+0000","last_fullsized":"2023-11-19T00:41:55.379460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.379368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:42.997475+0000","scrub_duration":0.0022750370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"75'60","reported_seq":142,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.966230+0000","last_change":"2023-11-19T00:41:35.966258+0000","last_active":"2023-11-19T00:41:35.966230+0000","last_peered":"2023-11-19T00:41:35.966230+0000","last_clean":"2023-11-19T00:41:35.966230+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:41:35.966230+0000","last_undegraded":"2023-11-19T00:41:35.966230+0000","last_fullsized":"2023-11-19T00:41:35.966230+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.966137+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:39.525924+0000","scrub_duration":0.010289223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":680,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:58.634147+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:58.634147+0000","last_peered":"2023-11-19T00:40:58.634147+0000","last_clean":"2023-11-19T00:40:58.634147+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:58.634147+0000","last_undegraded":"2023-11-19T00:40:58.634147+0000","last_fullsized":"2023-11-19T00:40:58.634147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.828389+0000","last_change":"2023-11-19T00:40:49.649378+0000","last_active":"2023-11-19T00:40:50.828389+0000","last_peered":"2023-11-19T00:40:50.828389+0000","last_clean":"2023-11-19T00:40:50.828389+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:40:50.828389+0000","last_undegraded":"2023-11-19T00:40:50.828389+0000","last_fullsized":"2023-11-19T00:40:50.828389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:38.737291+0000","last_clean_scrub_stamp":"2023-11-19T00:38:38.737291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:32.180644+0000","last_change":"2023-11-19T00:42:32.180679+0000","last_active":"2023-11-19T00:42:32.180644+0000","last_peered":"2023-11-19T00:42:32.180644+0000","last_clean":"2023-11-19T00:42:32.180644+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:42:32.180644+0000","last_undegraded":"2023-11-19T00:42:32.180644+0000","last_fullsized":"2023-11-19T00:42:32.180644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:32.180559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:32.180559+0000","last_clean_scrub_stamp":"2023-11-19T00:42:32.180559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:03.912458+0000","scrub_duration":0.0023940770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'158","reported_seq":456,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.629292+0000","last_change":"2023-11-19T00:40:48.632195+0000","last_active":"2023-11-19T00:40:50.629292+0000","last_peered":"2023-11-19T00:40:50.629292+0000","last_clean":"2023-11-19T00:40:50.629292+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:40:50.629292+0000","last_undegraded":"2023-11-19T00:40:50.629292+0000","last_fullsized":"2023-11-19T00:40:50.629292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:13.930783+0000","last_change":"2023-11-19T00:41:13.930804+0000","last_active":"2023-11-19T00:41:13.930783+0000","last_peered":"2023-11-19T00:41:13.930783+0000","last_clean":"2023-11-19T00:41:13.930783+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:41:13.930783+0000","last_undegraded":"2023-11-19T00:41:13.930783+0000","last_fullsized":"2023-11-19T00:41:13.930783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_clean_scrub_stamp":"2023-11-19T00:41:13.930701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:52.200874+0000","scrub_duration":0.001907448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.394157+0000","last_change":"2023-11-19T00:41:03.394178+0000","last_active":"2023-11-19T00:41:03.394157+0000","last_peered":"2023-11-19T00:41:03.394157+0000","last_clean":"2023-11-19T00:41:03.394157+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:41:03.394157+0000","last_undegraded":"2023-11-19T00:41:03.394157+0000","last_fullsized":"2023-11-19T00:41:03.394157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.394072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:55:33.909806+0000","scrub_duration":0.0022610909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"75'200","reported_seq":300,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:39.901625+0000","last_change":"2023-11-19T00:42:39.901680+0000","last_active":"2023-11-19T00:42:39.901625+0000","last_peered":"2023-11-19T00:42:39.901625+0000","last_clean":"2023-11-19T00:42:39.901625+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:42:39.901625+0000","last_undegraded":"2023-11-19T00:42:39.901625+0000","last_fullsized":"2023-11-19T00:42:39.901625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:39.901536+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:39.901536+0000","last_clean_scrub_stamp":"2023-11-19T00:42:39.901536+0000","objects_scrubbed":49,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:21.315367+0000","scrub_duration":0.032113575999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:02.407225+0000","last_change":"2023-11-19T00:41:02.407245+0000","last_active":"2023-11-19T00:41:02.407225+0000","last_peered":"2023-11-19T00:41:02.407225+0000","last_clean":"2023-11-19T00:41:02.407225+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:41:02.407225+0000","last_undegraded":"2023-11-19T00:41:02.407225+0000","last_fullsized":"2023-11-19T00:41:02.407225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_clean_scrub_stamp":"2023-11-19T00:41:02.407143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:08:56.907868+0000","scrub_duration":0.001710039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.946932+0000","last_change":"2023-11-19T00:41:50.946932+0000","last_active":"2023-11-19T00:41:50.946932+0000","last_peered":"2023-11-19T00:41:50.946932+0000","last_clean":"2023-11-19T00:41:50.946932+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:41:50.946932+0000","last_undegraded":"2023-11-19T00:41:50.946932+0000","last_fullsized":"2023-11-19T00:41:50.946932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.946825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:53:57.831781+0000","scrub_duration":0.001540832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"75'222","reported_seq":304,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.964232+0000","last_change":"2023-11-19T00:42:17.964280+0000","last_active":"2023-11-19T00:42:17.964232+0000","last_peered":"2023-11-19T00:42:17.964232+0000","last_clean":"2023-11-19T00:42:17.964232+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:42:17.964232+0000","last_undegraded":"2023-11-19T00:42:17.964232+0000","last_fullsized":"2023-11-19T00:42:17.964232+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'222","last_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_deep_scrub":"75'222","last_deep_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.964152+0000","objects_scrubbed":45,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:56.501645+0000","scrub_duration":0.030415533000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"75'3","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:01.281804+0000","last_change":"2023-11-19T00:42:01.281847+0000","last_active":"2023-11-19T00:42:01.281804+0000","last_peered":"2023-11-19T00:42:01.281804+0000","last_clean":"2023-11-19T00:42:01.281804+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:42:01.281804+0000","last_undegraded":"2023-11-19T00:42:01.281804+0000","last_fullsized":"2023-11-19T00:42:01.281804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_clean_scrub_stamp":"2023-11-19T00:42:01.281689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:43.656669+0000","scrub_duration":0.003362435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:33.306579+0000","last_change":"2023-11-19T00:41:33.306598+0000","last_active":"2023-11-19T00:41:33.306579+0000","last_peered":"2023-11-19T00:41:33.306579+0000","last_clean":"2023-11-19T00:41:33.306579+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:41:33.306579+0000","last_undegraded":"2023-11-19T00:41:33.306579+0000","last_fullsized":"2023-11-19T00:41:33.306579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_clean_scrub_stamp":"2023-11-19T00:41:33.306492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:54:35.500265+0000","scrub_duration":0.0019877990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"60'170","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628529+0000","last_change":"2023-11-19T00:40:48.637978+0000","last_active":"2023-11-19T00:40:50.628529+0000","last_peered":"2023-11-19T00:40:50.628529+0000","last_clean":"2023-11-19T00:40:50.628529+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:40:50.628529+0000","last_undegraded":"2023-11-19T00:40:50.628529+0000","last_fullsized":"2023-11-19T00:40:50.628529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"75'13","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.359683+0000","last_change":"2023-11-19T00:41:39.359724+0000","last_active":"2023-11-19T00:41:39.359683+0000","last_peered":"2023-11-19T00:41:39.359683+0000","last_clean":"2023-11-19T00:41:39.359683+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:41:39.359683+0000","last_undegraded":"2023-11-19T00:41:39.359683+0000","last_fullsized":"2023-11-19T00:41:39.359683+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'13","last_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_deep_scrub":"75'13","last_deep_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.359569+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:28.035657+0000","scrub_duration":0.0044493909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:18.983274+0000","last_change":"2023-11-19T00:41:18.983296+0000","last_active":"2023-11-19T00:41:18.983274+0000","last_peered":"2023-11-19T00:41:18.983274+0000","last_clean":"2023-11-19T00:41:18.983274+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:41:18.983274+0000","last_undegraded":"2023-11-19T00:41:18.983274+0000","last_fullsized":"2023-11-19T00:41:18.983274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_clean_scrub_stamp":"2023-11-19T00:41:18.983139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:41.254459+0000","scrub_duration":0.002267593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"75'186","reported_seq":285,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:32.952330+0000","last_change":"2023-11-19T00:41:32.952330+0000","last_active":"2023-11-19T00:41:32.952330+0000","last_peered":"2023-11-19T00:41:32.952330+0000","last_clean":"2023-11-19T00:41:32.952330+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:41:32.952330+0000","last_undegraded":"2023-11-19T00:41:32.952330+0000","last_fullsized":"2023-11-19T00:41:32.952330+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_clean_scrub_stamp":"2023-11-19T00:41:32.952223+0000","objects_scrubbed":51,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:14.957145+0000","scrub_duration":0.037260673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"75'218","reported_seq":519,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:25.289015+0000","last_change":"2023-11-19T00:42:25.289056+0000","last_active":"2023-11-19T00:42:25.289015+0000","last_peered":"2023-11-19T00:42:25.289015+0000","last_clean":"2023-11-19T00:42:25.289015+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:42:25.289015+0000","last_undegraded":"2023-11-19T00:42:25.289015+0000","last_fullsized":"2023-11-19T00:42:25.289015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'218","last_scrub_stamp":"2023-11-19T00:42:25.288919+0000","last_deep_scrub":"75'218","last_deep_scrub_stamp":"2023-11-19T00:42:25.288919+0000","last_clean_scrub_stamp":"2023-11-19T00:42:25.288919+0000","objects_scrubbed":50,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:12.971024+0000","scrub_duration":0.040409217999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"75'46","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:34.879339+0000","last_change":"2023-11-19T00:41:34.879370+0000","last_active":"2023-11-19T00:41:34.879339+0000","last_peered":"2023-11-19T00:41:34.879339+0000","last_clean":"2023-11-19T00:41:34.879339+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:41:34.879339+0000","last_undegraded":"2023-11-19T00:41:34.879339+0000","last_fullsized":"2023-11-19T00:41:34.879339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_clean_scrub_stamp":"2023-11-19T00:41:34.879255+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:29.054637+0000","scrub_duration":0.011582451000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"75'200","reported_seq":684,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:36.272713+0000","last_change":"2023-11-19T00:42:36.272763+0000","last_active":"2023-11-19T00:42:36.272713+0000","last_peered":"2023-11-19T00:42:36.272713+0000","last_clean":"2023-11-19T00:42:36.272713+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:42:36.272713+0000","last_undegraded":"2023-11-19T00:42:36.272713+0000","last_fullsized":"2023-11-19T00:42:36.272713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:36.272626+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:36.272626+0000","last_clean_scrub_stamp":"2023-11-19T00:42:36.272626+0000","objects_scrubbed":46,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:23.954732+0000","scrub_duration":0.031714834999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"75'21","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.005846+0000","last_change":"2023-11-19T00:41:35.005876+0000","last_active":"2023-11-19T00:41:35.005846+0000","last_peered":"2023-11-19T00:41:35.005846+0000","last_clean":"2023-11-19T00:41:35.005846+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:41:35.005846+0000","last_undegraded":"2023-11-19T00:41:35.005846+0000","last_fullsized":"2023-11-19T00:41:35.005846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'21","last_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_deep_scrub":"75'21","last_deep_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.005745+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:31:58.190130+0000","scrub_duration":0.0037074590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:49.033609+0000","last_change":"2023-11-19T00:41:49.033646+0000","last_active":"2023-11-19T00:41:49.033609+0000","last_peered":"2023-11-19T00:41:49.033609+0000","last_clean":"2023-11-19T00:41:49.033609+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:41:49.033609+0000","last_undegraded":"2023-11-19T00:41:49.033609+0000","last_fullsized":"2023-11-19T00:41:49.033609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_clean_scrub_stamp":"2023-11-19T00:41:49.033509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:09.818062+0000","scrub_duration":0.0016660780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"75'231","reported_seq":310,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:22.189106+0000","last_change":"2023-11-19T00:42:22.189147+0000","last_active":"2023-11-19T00:42:22.189106+0000","last_peered":"2023-11-19T00:42:22.189106+0000","last_clean":"2023-11-19T00:42:22.189106+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:42:22.189106+0000","last_undegraded":"2023-11-19T00:42:22.189106+0000","last_fullsized":"2023-11-19T00:42:22.189106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:42:22.189028+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:42:22.189028+0000","last_clean_scrub_stamp":"2023-11-19T00:42:22.189028+0000","objects_scrubbed":61,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:01.634373+0000","scrub_duration":0.042413226999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.247582+0000","last_change":"2023-11-19T00:42:07.247621+0000","last_active":"2023-11-19T00:42:07.247582+0000","last_peered":"2023-11-19T00:42:07.247582+0000","last_clean":"2023-11-19T00:42:07.247582+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:42:07.247582+0000","last_undegraded":"2023-11-19T00:42:07.247582+0000","last_fullsized":"2023-11-19T00:42:07.247582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.247482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:43.797824+0000","scrub_duration":0.0013240540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'155","reported_seq":443,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:50.628520+0000","last_change":"2023-11-19T00:40:48.632113+0000","last_active":"2023-11-19T00:40:50.628520+0000","last_peered":"2023-11-19T00:40:50.628520+0000","last_clean":"2023-11-19T00:40:50.628520+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:40:50.628520+0000","last_undegraded":"2023-11-19T00:40:50.628520+0000","last_fullsized":"2023-11-19T00:40:50.628520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'219","reported_seq":307,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.954334+0000","last_change":"2023-11-19T00:42:02.954366+0000","last_active":"2023-11-19T00:42:02.954334+0000","last_peered":"2023-11-19T00:42:02.954334+0000","last_clean":"2023-11-19T00:42:02.954334+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:42:02.954334+0000","last_undegraded":"2023-11-19T00:42:02.954334+0000","last_fullsized":"2023-11-19T00:42:02.954334+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'219","last_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_deep_scrub":"75'219","last_deep_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.954261+0000","objects_scrubbed":56,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:04.790371+0000","scrub_duration":0.040234886999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:44.366153+0000","last_change":"2023-11-19T00:41:44.366204+0000","last_active":"2023-11-19T00:41:44.366153+0000","last_peered":"2023-11-19T00:41:44.366153+0000","last_clean":"2023-11-19T00:41:44.366153+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:41:44.366153+0000","last_undegraded":"2023-11-19T00:41:44.366153+0000","last_fullsized":"2023-11-19T00:41:44.366153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'1","last_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_deep_scrub":"45'1","last_deep_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_clean_scrub_stamp":"2023-11-19T00:41:44.366059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:07:42.639601+0000","scrub_duration":0.001898725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"75'202","reported_seq":280,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:19.306630+0000","last_change":"2023-11-19T00:41:19.306669+0000","last_active":"2023-11-19T00:41:19.306630+0000","last_peered":"2023-11-19T00:41:19.306630+0000","last_clean":"2023-11-19T00:41:19.306630+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:41:19.306630+0000","last_undegraded":"2023-11-19T00:41:19.306630+0000","last_fullsized":"2023-11-19T00:41:19.306630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'202","last_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_deep_scrub":"75'202","last_deep_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:19.306536+0000","objects_scrubbed":49,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:17.124610+0000","scrub_duration":0.034907383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:06.281328+0000","last_change":"2023-11-19T00:41:06.281350+0000","last_active":"2023-11-19T00:41:06.281328+0000","last_peered":"2023-11-19T00:41:06.281328+0000","last_clean":"2023-11-19T00:41:06.281328+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:41:06.281328+0000","last_undegraded":"2023-11-19T00:41:06.281328+0000","last_fullsized":"2023-11-19T00:41:06.281328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_clean_scrub_stamp":"2023-11-19T00:41:06.281244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:23.140955+0000","scrub_duration":0.0017497389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"75'211","reported_seq":297,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:27.901382+0000","last_change":"2023-11-19T00:42:27.901444+0000","last_active":"2023-11-19T00:42:27.901382+0000","last_peered":"2023-11-19T00:42:27.901382+0000","last_clean":"2023-11-19T00:42:27.901382+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:42:27.901382+0000","last_undegraded":"2023-11-19T00:42:27.901382+0000","last_fullsized":"2023-11-19T00:42:27.901382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:42:27.901274+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:42:27.901274+0000","last_clean_scrub_stamp":"2023-11-19T00:42:27.901274+0000","objects_scrubbed":48,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:14.699783+0000","scrub_duration":0.037691249000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"75'6","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:34.899826+0000","last_change":"2023-11-19T00:42:34.899885+0000","last_active":"2023-11-19T00:42:34.899826+0000","last_peered":"2023-11-19T00:42:34.899826+0000","last_clean":"2023-11-19T00:42:34.899826+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:42:34.899826+0000","last_undegraded":"2023-11-19T00:42:34.899826+0000","last_fullsized":"2023-11-19T00:42:34.899826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2023-11-19T00:42:34.899734+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2023-11-19T00:42:34.899734+0000","last_clean_scrub_stamp":"2023-11-19T00:42:34.899734+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:39:28.534968+0000","scrub_duration":0.0089668409999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"75'220","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.986982+0000","last_change":"2023-11-19T00:41:15.986982+0000","last_active":"2023-11-19T00:41:15.986982+0000","last_peered":"2023-11-19T00:41:15.986982+0000","last_clean":"2023-11-19T00:41:15.986982+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:41:15.986982+0000","last_undegraded":"2023-11-19T00:41:15.986982+0000","last_fullsized":"2023-11-19T00:41:15.986982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.986886+0000","objects_scrubbed":53,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:40.565603+0000","scrub_duration":0.036034849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"75'7","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:29.949945+0000","last_change":"2023-11-19T00:41:29.949973+0000","last_active":"2023-11-19T00:41:29.949945+0000","last_peered":"2023-11-19T00:41:29.949945+0000","last_clean":"2023-11-19T00:41:29.949945+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:41:29.949945+0000","last_undegraded":"2023-11-19T00:41:29.949945+0000","last_fullsized":"2023-11-19T00:41:29.949945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'7","last_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_deep_scrub":"75'7","last_deep_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_clean_scrub_stamp":"2023-11-19T00:41:29.949858+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:16:37.535582+0000","scrub_duration":0.009494878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"75'207","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.229246+0000","last_change":"2023-11-19T00:42:02.229284+0000","last_active":"2023-11-19T00:42:02.229246+0000","last_peered":"2023-11-19T00:42:02.229246+0000","last_clean":"2023-11-19T00:42:02.229246+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:42:02.229246+0000","last_undegraded":"2023-11-19T00:42:02.229246+0000","last_fullsized":"2023-11-19T00:42:02.229246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.229170+0000","objects_scrubbed":66,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:38.779512+0000","scrub_duration":0.044979045000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"75'3","reported_seq":90,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:31.202683+0000","last_change":"2023-11-19T00:42:31.202710+0000","last_active":"2023-11-19T00:42:31.202683+0000","last_peered":"2023-11-19T00:42:31.202683+0000","last_clean":"2023-11-19T00:42:31.202683+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:42:31.202683+0000","last_undegraded":"2023-11-19T00:42:31.202683+0000","last_fullsized":"2023-11-19T00:42:31.202683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:31.202607+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:31.202607+0000","last_clean_scrub_stamp":"2023-11-19T00:42:31.202607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:59.375894+0000","scrub_duration":0.003221341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"59'161","reported_seq":214,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:01.443590+0000","last_change":"2023-11-19T00:40:49.649586+0000","last_active":"2023-11-19T00:41:01.443590+0000","last_peered":"2023-11-19T00:41:01.443590+0000","last_clean":"2023-11-19T00:41:01.443590+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:41:01.443590+0000","last_undegraded":"2023-11-19T00:41:01.443590+0000","last_fullsized":"2023-11-19T00:41:01.443590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"75'56","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.925143+0000","last_change":"2023-11-19T00:41:48.925171+0000","last_active":"2023-11-19T00:41:48.925143+0000","last_peered":"2023-11-19T00:41:48.925143+0000","last_clean":"2023-11-19T00:41:48.925143+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:41:48.925143+0000","last_undegraded":"2023-11-19T00:41:48.925143+0000","last_fullsized":"2023-11-19T00:41:48.925143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'56","last_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_deep_scrub":"75'56","last_deep_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.925067+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:26:37.416531+0000","scrub_duration":0.016421860999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"75'228","reported_seq":543,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.083829+0000","last_change":"2023-11-19T00:41:04.083863+0000","last_active":"2023-11-19T00:41:04.083829+0000","last_peered":"2023-11-19T00:41:04.083829+0000","last_clean":"2023-11-19T00:41:04.083829+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:41:04.083829+0000","last_undegraded":"2023-11-19T00:41:04.083829+0000","last_fullsized":"2023-11-19T00:41:04.083829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'228","last_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_deep_scrub":"75'228","last_deep_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.083754+0000","objects_scrubbed":57,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:04:56.786572+0000","scrub_duration":0.039326976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"75'3","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.242942+0000","last_change":"2023-11-19T00:42:13.242967+0000","last_active":"2023-11-19T00:42:13.242942+0000","last_peered":"2023-11-19T00:42:13.242942+0000","last_clean":"2023-11-19T00:42:13.242942+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:42:13.242942+0000","last_undegraded":"2023-11-19T00:42:13.242942+0000","last_fullsized":"2023-11-19T00:42:13.242942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.242851+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:19.880790+0000","scrub_duration":0.0092839810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"75'254","reported_seq":579,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:45.012072+0000","last_change":"2023-11-19T00:41:45.012108+0000","last_active":"2023-11-19T00:41:45.012072+0000","last_peered":"2023-11-19T00:41:45.012072+0000","last_clean":"2023-11-19T00:41:45.012072+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:41:45.012072+0000","last_undegraded":"2023-11-19T00:41:45.012072+0000","last_fullsized":"2023-11-19T00:41:45.012072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'254","last_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_deep_scrub":"75'254","last_deep_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_clean_scrub_stamp":"2023-11-19T00:41:45.011994+0000","objects_scrubbed":64,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:03.705015+0000","scrub_duration":0.043843721000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"75'18","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:11.205693+0000","last_change":"2023-11-19T00:41:11.205737+0000","last_active":"2023-11-19T00:41:11.205693+0000","last_peered":"2023-11-19T00:41:11.205693+0000","last_clean":"2023-11-19T00:41:11.205693+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:41:11.205693+0000","last_undegraded":"2023-11-19T00:41:11.205693+0000","last_fullsized":"2023-11-19T00:41:11.205693+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'18","last_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_deep_scrub":"75'18","last_deep_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_clean_scrub_stamp":"2023-11-19T00:41:11.205579+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:37.711995+0000","scrub_duration":0.010464658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13178,"ondisk_log_size":13178,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":464,"ondisk_log_size":464,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107312,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94264528,"statfs":{"total":96636764160,"available":96526876672,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.186,"5min":0.156,"15min":0.156},"max":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.443,"5min":0.42699999999999999,"15min":0.434},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.60899999999999999,"5min":0.625,"15min":0.625},"last":0.33100000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.59299999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.443,"15min":0.45500000000000002},"min":{"1min":0.26600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.376}]}]},{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110068,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94261772,"statfs":{"total":96636764160,"available":96524054528,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.253,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.68400000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.253},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.47399999999999998},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.30499999999999999}]},{"osd":1,"last update":"Sun Nov 19 00:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45400000000000001,"15min":0.46999999999999997},"min":{"1min":0.32000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.622,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34200000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738421,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100804,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94271036,"statfs":{"total":96636764160,"available":96533540864,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60399999999999998,"5min":0.625,"15min":0.625},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Nov 19 00:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.29899999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.379},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:42:43.501 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.502 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.502 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.502 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.502 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-19T00:38:42.752781+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=42, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.503 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.503 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-19T00:38:38.737291+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=38, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.503 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.503 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.504 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.504 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:42:43.504 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-19T00:43:03.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:43:03.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:43:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:43:03.832 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2023-11-19T00:43:03.080613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14239,"ondisk_log_size":14239,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":305704,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":151803,"kb_avail":282809816,"statfs":{"total":289910292480,"available":289597251584,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":155446607},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002940"},"pg_stats":[{"pgid":"4.3f","version":"75'215","reported_seq":512,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.015195+0000","last_change":"2023-11-19T00:41:12.015195+0000","last_active":"2023-11-19T00:41:12.015195+0000","last_peered":"2023-11-19T00:41:12.015195+0000","last_clean":"2023-11-19T00:41:12.015195+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:41:12.015195+0000","last_undegraded":"2023-11-19T00:41:12.015195+0000","last_fullsized":"2023-11-19T00:41:12.015195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.015097+0000","objects_scrubbed":50,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:27.053797+0000","scrub_duration":0.036690850999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"75'207","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:04.947449+0000","last_change":"2023-11-19T00:42:04.947449+0000","last_active":"2023-11-19T00:42:04.947449+0000","last_peered":"2023-11-19T00:42:04.947449+0000","last_clean":"2023-11-19T00:42:04.947449+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:42:04.947449+0000","last_undegraded":"2023-11-19T00:42:04.947449+0000","last_fullsized":"2023-11-19T00:42:04.947449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_clean_scrub_stamp":"2023-11-19T00:42:04.947330+0000","objects_scrubbed":45,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:45:23.142624+0000","scrub_duration":0.031262616999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"75'207","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.223244+0000","last_change":"2023-11-19T00:42:13.223244+0000","last_active":"2023-11-19T00:42:13.223244+0000","last_peered":"2023-11-19T00:42:13.223244+0000","last_clean":"2023-11-19T00:42:13.223244+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:42:13.223244+0000","last_undegraded":"2023-11-19T00:42:13.223244+0000","last_fullsized":"2023-11-19T00:42:13.223244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.223119+0000","objects_scrubbed":39,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:01:18.136942+0000","scrub_duration":0.027099018999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"75'172","reported_seq":233,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:10.950107+0000","last_change":"2023-11-19T00:41:10.950107+0000","last_active":"2023-11-19T00:41:10.950107+0000","last_peered":"2023-11-19T00:41:10.950107+0000","last_clean":"2023-11-19T00:41:10.950107+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:41:10.950107+0000","last_undegraded":"2023-11-19T00:41:10.950107+0000","last_fullsized":"2023-11-19T00:41:10.950107+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'172","last_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_deep_scrub":"75'172","last_deep_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_clean_scrub_stamp":"2023-11-19T00:41:10.950010+0000","objects_scrubbed":51,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:03.687754+0000","scrub_duration":0.034903271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"75'236","reported_seq":573,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:50.813703+0000","last_change":"2023-11-19T00:42:50.813773+0000","last_active":"2023-11-19T00:42:50.813703+0000","last_peered":"2023-11-19T00:42:50.813703+0000","last_clean":"2023-11-19T00:42:50.813703+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:42:50.813703+0000","last_undegraded":"2023-11-19T00:42:50.813703+0000","last_fullsized":"2023-11-19T00:42:50.813703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'236","last_scrub_stamp":"2023-11-19T00:42:50.813607+0000","last_deep_scrub":"75'236","last_deep_scrub_stamp":"2023-11-19T00:42:50.813607+0000","last_clean_scrub_stamp":"2023-11-19T00:42:50.813607+0000","objects_scrubbed":65,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:26:11.598161+0000","scrub_duration":0.045240623000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"75'221","reported_seq":519,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:29.297602+0000","last_change":"2023-11-19T00:42:29.297650+0000","last_active":"2023-11-19T00:42:29.297602+0000","last_peered":"2023-11-19T00:42:29.297602+0000","last_clean":"2023-11-19T00:42:29.297602+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:42:29.297602+0000","last_undegraded":"2023-11-19T00:42:29.297602+0000","last_fullsized":"2023-11-19T00:42:29.297602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:42:29.297503+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:42:29.297503+0000","last_clean_scrub_stamp":"2023-11-19T00:42:29.297503+0000","objects_scrubbed":55,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:50:20.920428+0000","scrub_duration":0.039328285999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"75'227","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:41.910516+0000","last_change":"2023-11-19T00:41:41.910554+0000","last_active":"2023-11-19T00:41:41.910516+0000","last_peered":"2023-11-19T00:41:41.910516+0000","last_clean":"2023-11-19T00:41:41.910516+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:41:41.910516+0000","last_undegraded":"2023-11-19T00:41:41.910516+0000","last_fullsized":"2023-11-19T00:41:41.910516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'227","last_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_deep_scrub":"75'227","last_deep_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_clean_scrub_stamp":"2023-11-19T00:41:41.910446+0000","objects_scrubbed":62,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:52.519112+0000","scrub_duration":0.043757361000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"75'179","reported_seq":426,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.949857+0000","last_change":"2023-11-19T00:41:36.949897+0000","last_active":"2023-11-19T00:41:36.949857+0000","last_peered":"2023-11-19T00:41:36.949857+0000","last_clean":"2023-11-19T00:41:36.949857+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:41:36.949857+0000","last_undegraded":"2023-11-19T00:41:36.949857+0000","last_fullsized":"2023-11-19T00:41:36.949857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'179","last_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_deep_scrub":"75'179","last_deep_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.949768+0000","objects_scrubbed":48,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:32.130529+0000","scrub_duration":0.033692611999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.238253+0000","last_change":"2023-11-19T00:41:08.238253+0000","last_active":"2023-11-19T00:41:08.238253+0000","last_peered":"2023-11-19T00:41:08.238253+0000","last_clean":"2023-11-19T00:41:08.238253+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:41:08.238253+0000","last_undegraded":"2023-11-19T00:41:08.238253+0000","last_fullsized":"2023-11-19T00:41:08.238253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.238154+0000","objects_scrubbed":51,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:28:28.657653+0000","scrub_duration":0.035756160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"75'197","reported_seq":470,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:40.870526+0000","last_change":"2023-11-19T00:42:40.870564+0000","last_active":"2023-11-19T00:42:40.870526+0000","last_peered":"2023-11-19T00:42:40.870526+0000","last_clean":"2023-11-19T00:42:40.870526+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:42:40.870526+0000","last_undegraded":"2023-11-19T00:42:40.870526+0000","last_fullsized":"2023-11-19T00:42:40.870526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'197","last_scrub_stamp":"2023-11-19T00:42:40.870444+0000","last_deep_scrub":"75'197","last_deep_scrub_stamp":"2023-11-19T00:42:40.870444+0000","last_clean_scrub_stamp":"2023-11-19T00:42:40.870444+0000","objects_scrubbed":49,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:58:51.479110+0000","scrub_duration":0.031404438999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"75'215","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.969246+0000","last_change":"2023-11-19T00:41:15.969271+0000","last_active":"2023-11-19T00:41:15.969246+0000","last_peered":"2023-11-19T00:41:15.969246+0000","last_clean":"2023-11-19T00:41:15.969246+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:41:15.969246+0000","last_undegraded":"2023-11-19T00:41:15.969246+0000","last_fullsized":"2023-11-19T00:41:15.969246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.969180+0000","objects_scrubbed":56,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:37:03.160511+0000","scrub_duration":0.046149739000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"75'191","reported_seq":277,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.898049+0000","last_change":"2023-11-19T00:42:20.898107+0000","last_active":"2023-11-19T00:42:20.898049+0000","last_peered":"2023-11-19T00:42:20.898049+0000","last_clean":"2023-11-19T00:42:20.898049+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:42:20.898049+0000","last_undegraded":"2023-11-19T00:42:20.898049+0000","last_fullsized":"2023-11-19T00:42:20.898049+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'191","last_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_deep_scrub":"75'191","last_deep_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.897961+0000","objects_scrubbed":55,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:41.542056+0000","scrub_duration":0.041092573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"75'183","reported_seq":633,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:09.037113+0000","last_change":"2023-11-19T00:41:09.037113+0000","last_active":"2023-11-19T00:41:09.037113+0000","last_peered":"2023-11-19T00:41:09.037113+0000","last_clean":"2023-11-19T00:41:09.037113+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:41:09.037113+0000","last_undegraded":"2023-11-19T00:41:09.037113+0000","last_fullsized":"2023-11-19T00:41:09.037113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'183","last_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_deep_scrub":"75'183","last_deep_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_clean_scrub_stamp":"2023-11-19T00:41:09.037014+0000","objects_scrubbed":50,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:26.814001+0000","scrub_duration":0.033302804999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"75'224","reported_seq":724,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:52.995941+0000","last_change":"2023-11-19T00:41:52.995980+0000","last_active":"2023-11-19T00:41:52.995941+0000","last_peered":"2023-11-19T00:41:52.995941+0000","last_clean":"2023-11-19T00:41:52.995941+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:41:52.995941+0000","last_undegraded":"2023-11-19T00:41:52.995941+0000","last_fullsized":"2023-11-19T00:41:52.995941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'224","last_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_deep_scrub":"75'224","last_deep_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_clean_scrub_stamp":"2023-11-19T00:41:52.995854+0000","objects_scrubbed":44,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:27.412450+0000","scrub_duration":0.030047951999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"75'206","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.250517+0000","last_change":"2023-11-19T00:42:07.250542+0000","last_active":"2023-11-19T00:42:07.250517+0000","last_peered":"2023-11-19T00:42:07.250517+0000","last_clean":"2023-11-19T00:42:07.250517+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:42:07.250517+0000","last_undegraded":"2023-11-19T00:42:07.250517+0000","last_fullsized":"2023-11-19T00:42:07.250517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.250444+0000","objects_scrubbed":50,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:41:30.400474+0000","scrub_duration":0.034619200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'231","reported_seq":298,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:51.008109+0000","last_change":"2023-11-19T00:41:51.008143+0000","last_active":"2023-11-19T00:41:51.008109+0000","last_peered":"2023-11-19T00:41:51.008109+0000","last_clean":"2023-11-19T00:41:51.008109+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:41:51.008109+0000","last_undegraded":"2023-11-19T00:41:51.008109+0000","last_fullsized":"2023-11-19T00:41:51.008109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_clean_scrub_stamp":"2023-11-19T00:41:51.008026+0000","objects_scrubbed":58,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:38.626133+0000","scrub_duration":0.041732172999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"75'207","reported_seq":286,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.461743+0000","last_change":"2023-11-19T00:41:48.461784+0000","last_active":"2023-11-19T00:41:48.461743+0000","last_peered":"2023-11-19T00:41:48.461743+0000","last_clean":"2023-11-19T00:41:48.461743+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:41:48.461743+0000","last_undegraded":"2023-11-19T00:41:48.461743+0000","last_fullsized":"2023-11-19T00:41:48.461743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.461644+0000","objects_scrubbed":53,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:30:42.739782+0000","scrub_duration":0.045335093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"75'199","reported_seq":483,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.090823+0000","last_change":"2023-11-19T00:41:03.090862+0000","last_active":"2023-11-19T00:41:03.090823+0000","last_peered":"2023-11-19T00:41:03.090823+0000","last_clean":"2023-11-19T00:41:03.090823+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:41:03.090823+0000","last_undegraded":"2023-11-19T00:41:03.090823+0000","last_fullsized":"2023-11-19T00:41:03.090823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.090716+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:42.528537+0000","scrub_duration":0.045074112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"75'196","reported_seq":478,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:33.311076+0000","last_change":"2023-11-19T00:42:33.311118+0000","last_active":"2023-11-19T00:42:33.311076+0000","last_peered":"2023-11-19T00:42:33.311076+0000","last_clean":"2023-11-19T00:42:33.311076+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:42:33.311076+0000","last_undegraded":"2023-11-19T00:42:33.311076+0000","last_fullsized":"2023-11-19T00:42:33.311076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'196","last_scrub_stamp":"2023-11-19T00:42:33.310988+0000","last_deep_scrub":"75'196","last_deep_scrub_stamp":"2023-11-19T00:42:33.310988+0000","last_clean_scrub_stamp":"2023-11-19T00:42:33.310988+0000","objects_scrubbed":51,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:20.855882+0000","scrub_duration":0.041832331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"75'221","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.963592+0000","last_change":"2023-11-19T00:41:04.963623+0000","last_active":"2023-11-19T00:41:04.963592+0000","last_peered":"2023-11-19T00:41:04.963592+0000","last_clean":"2023-11-19T00:41:04.963592+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:41:04.963592+0000","last_undegraded":"2023-11-19T00:41:04.963592+0000","last_fullsized":"2023-11-19T00:41:04.963592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.963516+0000","objects_scrubbed":56,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:06.799626+0000","scrub_duration":0.039865746000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"75'217","reported_seq":275,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.942577+0000","last_change":"2023-11-19T00:41:12.942606+0000","last_active":"2023-11-19T00:41:12.942577+0000","last_peered":"2023-11-19T00:41:12.942577+0000","last_clean":"2023-11-19T00:41:12.942577+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:41:12.942577+0000","last_undegraded":"2023-11-19T00:41:12.942577+0000","last_fullsized":"2023-11-19T00:41:12.942577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'217","last_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_deep_scrub":"75'217","last_deep_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.942504+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:29.802215+0000","scrub_duration":0.042793523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:10.027915+0000","last_change":"2023-11-19T00:42:10.027942+0000","last_active":"2023-11-19T00:42:10.027915+0000","last_peered":"2023-11-19T00:42:10.027915+0000","last_clean":"2023-11-19T00:42:10.027915+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:42:10.027915+0000","last_undegraded":"2023-11-19T00:42:10.027915+0000","last_fullsized":"2023-11-19T00:42:10.027915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_clean_scrub_stamp":"2023-11-19T00:42:10.027812+0000","objects_scrubbed":54,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:40.543546+0000","scrub_duration":0.042942501000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"75'211","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.392748+0000","last_change":"2023-11-19T00:41:42.392777+0000","last_active":"2023-11-19T00:41:42.392748+0000","last_peered":"2023-11-19T00:41:42.392748+0000","last_clean":"2023-11-19T00:41:42.392748+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:41:42.392748+0000","last_undegraded":"2023-11-19T00:41:42.392748+0000","last_fullsized":"2023-11-19T00:41:42.392748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.392663+0000","objects_scrubbed":60,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:23.806495+0000","scrub_duration":0.040785126999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"75'212","reported_seq":276,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:36.921953+0000","last_change":"2023-11-19T00:42:36.921989+0000","last_active":"2023-11-19T00:42:36.921953+0000","last_peered":"2023-11-19T00:42:36.921953+0000","last_clean":"2023-11-19T00:42:36.921953+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:42:36.921953+0000","last_undegraded":"2023-11-19T00:42:36.921953+0000","last_fullsized":"2023-11-19T00:42:36.921953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'212","last_scrub_stamp":"2023-11-19T00:42:36.921879+0000","last_deep_scrub":"75'212","last_deep_scrub_stamp":"2023-11-19T00:42:36.921879+0000","last_clean_scrub_stamp":"2023-11-19T00:42:36.921879+0000","objects_scrubbed":49,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:17:25.597966+0000","scrub_duration":0.031590009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"75'213","reported_seq":313,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.957022+0000","last_change":"2023-11-19T00:41:26.957022+0000","last_active":"2023-11-19T00:41:26.957022+0000","last_peered":"2023-11-19T00:41:26.957022+0000","last_clean":"2023-11-19T00:41:26.957022+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:41:26.957022+0000","last_undegraded":"2023-11-19T00:41:26.957022+0000","last_fullsized":"2023-11-19T00:41:26.957022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.956876+0000","objects_scrubbed":53,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:31:00.258795+0000","scrub_duration":0.041573285000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"75'246","reported_seq":325,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:30.252873+0000","last_change":"2023-11-19T00:41:30.252904+0000","last_active":"2023-11-19T00:41:30.252873+0000","last_peered":"2023-11-19T00:41:30.252873+0000","last_clean":"2023-11-19T00:41:30.252873+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:41:30.252873+0000","last_undegraded":"2023-11-19T00:41:30.252873+0000","last_fullsized":"2023-11-19T00:41:30.252873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'246","last_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_deep_scrub":"75'246","last_deep_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_clean_scrub_stamp":"2023-11-19T00:41:30.252803+0000","objects_scrubbed":61,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:05:30.610485+0000","scrub_duration":0.045754178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"75'200","reported_seq":283,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.237889+0000","last_change":"2023-11-19T00:42:15.237917+0000","last_active":"2023-11-19T00:42:15.237889+0000","last_peered":"2023-11-19T00:42:15.237889+0000","last_clean":"2023-11-19T00:42:15.237889+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:42:15.237889+0000","last_undegraded":"2023-11-19T00:42:15.237889+0000","last_fullsized":"2023-11-19T00:42:15.237889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.237806+0000","objects_scrubbed":52,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:11:37.875363+0000","scrub_duration":0.035472484999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"75'195","reported_seq":294,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:14.991861+0000","last_change":"2023-11-19T00:41:14.991861+0000","last_active":"2023-11-19T00:41:14.991861+0000","last_peered":"2023-11-19T00:41:14.991861+0000","last_clean":"2023-11-19T00:41:14.991861+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:41:14.991861+0000","last_undegraded":"2023-11-19T00:41:14.991861+0000","last_fullsized":"2023-11-19T00:41:14.991861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'195","last_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_deep_scrub":"75'195","last_deep_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_clean_scrub_stamp":"2023-11-19T00:41:14.991747+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:33.385240+0000","scrub_duration":0.031971732000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"75'224","reported_seq":744,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:58.356612+0000","last_change":"2023-11-19T00:42:58.356612+0000","last_active":"2023-11-19T00:42:58.356612+0000","last_peered":"2023-11-19T00:42:58.356612+0000","last_clean":"2023-11-19T00:42:58.356612+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:42:58.356612+0000","last_undegraded":"2023-11-19T00:42:58.356612+0000","last_fullsized":"2023-11-19T00:42:58.356612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'224","last_scrub_stamp":"2023-11-19T00:42:58.356491+0000","last_deep_scrub":"75'224","last_deep_scrub_stamp":"2023-11-19T00:42:58.356491+0000","last_clean_scrub_stamp":"2023-11-19T00:42:58.356491+0000","objects_scrubbed":64,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:53.238401+0000","scrub_duration":0.051649353000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"75'253","reported_seq":343,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:29.855731+0000","last_change":"2023-11-19T00:42:29.855731+0000","last_active":"2023-11-19T00:42:29.855731+0000","last_peered":"2023-11-19T00:42:29.855731+0000","last_clean":"2023-11-19T00:42:29.855731+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:42:29.855731+0000","last_undegraded":"2023-11-19T00:42:29.855731+0000","last_fullsized":"2023-11-19T00:42:29.855731+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'253","last_scrub_stamp":"2023-11-19T00:42:29.855630+0000","last_deep_scrub":"75'253","last_deep_scrub_stamp":"2023-11-19T00:42:29.855630+0000","last_clean_scrub_stamp":"2023-11-19T00:42:29.855630+0000","objects_scrubbed":64,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:46.808688+0000","scrub_duration":0.046923685999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"75'255","reported_seq":843,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:34.351762+0000","last_change":"2023-11-19T00:42:34.351762+0000","last_active":"2023-11-19T00:42:34.351762+0000","last_peered":"2023-11-19T00:42:34.351762+0000","last_clean":"2023-11-19T00:42:34.351762+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:42:34.351762+0000","last_undegraded":"2023-11-19T00:42:34.351762+0000","last_fullsized":"2023-11-19T00:42:34.351762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'255","last_scrub_stamp":"2023-11-19T00:42:34.351651+0000","last_deep_scrub":"75'255","last_deep_scrub_stamp":"2023-11-19T00:42:34.351651+0000","last_clean_scrub_stamp":"2023-11-19T00:42:34.351651+0000","objects_scrubbed":61,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:28:06.035302+0000","scrub_duration":0.041563124999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"75'234","reported_seq":294,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.033234+0000","last_change":"2023-11-19T00:41:55.033234+0000","last_active":"2023-11-19T00:41:55.033234+0000","last_peered":"2023-11-19T00:41:55.033234+0000","last_clean":"2023-11-19T00:41:55.033234+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:41:55.033234+0000","last_undegraded":"2023-11-19T00:41:55.033234+0000","last_fullsized":"2023-11-19T00:41:55.033234+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'234","last_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_deep_scrub":"75'234","last_deep_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.033097+0000","objects_scrubbed":50,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:01.427989+0000","scrub_duration":0.036056435999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"75'189","reported_seq":465,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:51.813857+0000","last_change":"2023-11-19T00:42:51.813882+0000","last_active":"2023-11-19T00:42:51.813857+0000","last_peered":"2023-11-19T00:42:51.813857+0000","last_clean":"2023-11-19T00:42:51.813857+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:42:51.813857+0000","last_undegraded":"2023-11-19T00:42:51.813857+0000","last_fullsized":"2023-11-19T00:42:51.813857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'189","last_scrub_stamp":"2023-11-19T00:42:51.813782+0000","last_deep_scrub":"75'189","last_deep_scrub_stamp":"2023-11-19T00:42:51.813782+0000","last_clean_scrub_stamp":"2023-11-19T00:42:51.813782+0000","objects_scrubbed":51,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:18.342230+0000","scrub_duration":0.035874337999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'140","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.861697+0000","last_change":"2023-11-19T00:41:08.861726+0000","last_active":"2023-11-19T00:41:08.861697+0000","last_peered":"2023-11-19T00:41:08.861697+0000","last_clean":"2023-11-19T00:41:08.861697+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:41:08.861697+0000","last_undegraded":"2023-11-19T00:41:08.861697+0000","last_fullsized":"2023-11-19T00:41:08.861697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'140","last_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_deep_scrub":"75'140","last_deep_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.861626+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:02.346222+0000","scrub_duration":0.0096612360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"75'238","reported_seq":523,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:46.783553+0000","last_change":"2023-11-19T00:42:46.783590+0000","last_active":"2023-11-19T00:42:46.783553+0000","last_peered":"2023-11-19T00:42:46.783553+0000","last_clean":"2023-11-19T00:42:46.783553+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:42:46.783553+0000","last_undegraded":"2023-11-19T00:42:46.783553+0000","last_fullsized":"2023-11-19T00:42:46.783553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'238","last_scrub_stamp":"2023-11-19T00:42:46.783480+0000","last_deep_scrub":"75'238","last_deep_scrub_stamp":"2023-11-19T00:42:46.783480+0000","last_clean_scrub_stamp":"2023-11-19T00:42:46.783480+0000","objects_scrubbed":41,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:41.061618+0000","scrub_duration":0.028011919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:58.324049+0000","last_change":"2023-11-19T00:41:58.324092+0000","last_active":"2023-11-19T00:41:58.324049+0000","last_peered":"2023-11-19T00:41:58.324049+0000","last_clean":"2023-11-19T00:41:58.324049+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:41:58.324049+0000","last_undegraded":"2023-11-19T00:41:58.324049+0000","last_fullsized":"2023-11-19T00:41:58.324049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_clean_scrub_stamp":"2023-11-19T00:41:58.323959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:04.718851+0000","scrub_duration":0.0018957519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'236","reported_seq":315,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:53.485524+0000","last_change":"2023-11-19T00:41:53.485557+0000","last_active":"2023-11-19T00:41:53.485524+0000","last_peered":"2023-11-19T00:41:53.485524+0000","last_clean":"2023-11-19T00:41:53.485524+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:41:53.485524+0000","last_undegraded":"2023-11-19T00:41:53.485524+0000","last_fullsized":"2023-11-19T00:41:53.485524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'236","last_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_deep_scrub":"75'236","last_deep_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_clean_scrub_stamp":"2023-11-19T00:41:53.485439+0000","objects_scrubbed":63,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:20.013886+0000","scrub_duration":0.043385156000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:19.896895+0000","last_change":"2023-11-19T00:42:19.896917+0000","last_active":"2023-11-19T00:42:19.896895+0000","last_peered":"2023-11-19T00:42:19.896895+0000","last_clean":"2023-11-19T00:42:19.896895+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:42:19.896895+0000","last_undegraded":"2023-11-19T00:42:19.896895+0000","last_fullsized":"2023-11-19T00:42:19.896895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_clean_scrub_stamp":"2023-11-19T00:42:19.896803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:36:46.403219+0000","scrub_duration":0.0019930909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"75'206","reported_seq":274,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.456295+0000","last_change":"2023-11-19T00:41:50.456322+0000","last_active":"2023-11-19T00:41:50.456295+0000","last_peered":"2023-11-19T00:41:50.456295+0000","last_clean":"2023-11-19T00:41:50.456295+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:41:50.456295+0000","last_undegraded":"2023-11-19T00:41:50.456295+0000","last_fullsized":"2023-11-19T00:41:50.456295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.456210+0000","objects_scrubbed":54,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:50:56.340582+0000","scrub_duration":0.037720240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"75'12","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:17.957067+0000","last_change":"2023-11-19T00:41:17.957098+0000","last_active":"2023-11-19T00:41:17.957067+0000","last_peered":"2023-11-19T00:41:17.957067+0000","last_clean":"2023-11-19T00:41:17.957067+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:41:17.957067+0000","last_undegraded":"2023-11-19T00:41:17.957067+0000","last_fullsized":"2023-11-19T00:41:17.957067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_clean_scrub_stamp":"2023-11-19T00:41:17.956986+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:03:50.209311+0000","scrub_duration":0.0041360729999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"75'2","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.876155+0000","last_change":"2023-11-19T00:41:39.876223+0000","last_active":"2023-11-19T00:41:39.876155+0000","last_peered":"2023-11-19T00:41:39.876155+0000","last_clean":"2023-11-19T00:41:39.876155+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:41:39.876155+0000","last_undegraded":"2023-11-19T00:41:39.876155+0000","last_fullsized":"2023-11-19T00:41:39.876155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.876064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:21.289896+0000","scrub_duration":0.0035587930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"75'211","reported_seq":300,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.930138+0000","last_change":"2023-11-19T00:42:15.930166+0000","last_active":"2023-11-19T00:42:15.930138+0000","last_peered":"2023-11-19T00:42:15.930138+0000","last_clean":"2023-11-19T00:42:15.930138+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:42:15.930138+0000","last_undegraded":"2023-11-19T00:42:15.930138+0000","last_fullsized":"2023-11-19T00:42:15.930138+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.930063+0000","objects_scrubbed":52,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:39:54.200236+0000","scrub_duration":0.037878510999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"75'4","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.934069+0000","last_change":"2023-11-19T00:42:05.934099+0000","last_active":"2023-11-19T00:42:05.934069+0000","last_peered":"2023-11-19T00:42:05.934069+0000","last_clean":"2023-11-19T00:42:05.934069+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:42:05.934069+0000","last_undegraded":"2023-11-19T00:42:05.934069+0000","last_fullsized":"2023-11-19T00:42:05.934069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.933982+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:00:07.479529+0000","scrub_duration":0.0031029730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"75'225","reported_seq":541,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.058808+0000","last_change":"2023-11-19T00:41:42.058808+0000","last_active":"2023-11-19T00:41:42.058808+0000","last_peered":"2023-11-19T00:41:42.058808+0000","last_clean":"2023-11-19T00:41:42.058808+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:41:42.058808+0000","last_undegraded":"2023-11-19T00:41:42.058808+0000","last_fullsized":"2023-11-19T00:41:42.058808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'225","last_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_deep_scrub":"75'225","last_deep_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.058668+0000","objects_scrubbed":58,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:08.830501+0000","scrub_duration":0.041143718000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"75'3","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:21.189979+0000","last_change":"2023-11-19T00:42:21.190005+0000","last_active":"2023-11-19T00:42:21.189979+0000","last_peered":"2023-11-19T00:42:21.189979+0000","last_clean":"2023-11-19T00:42:21.189979+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:42:21.189979+0000","last_undegraded":"2023-11-19T00:42:21.189979+0000","last_fullsized":"2023-11-19T00:42:21.189979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_clean_scrub_stamp":"2023-11-19T00:42:21.189891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:08.734785+0000","scrub_duration":0.0034598979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"75'201","reported_seq":481,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.932131+0000","last_change":"2023-11-19T00:41:07.932168+0000","last_active":"2023-11-19T00:41:07.932131+0000","last_peered":"2023-11-19T00:41:07.932131+0000","last_clean":"2023-11-19T00:41:07.932131+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:41:07.932131+0000","last_undegraded":"2023-11-19T00:41:07.932131+0000","last_fullsized":"2023-11-19T00:41:07.932131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'201","last_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_deep_scrub":"75'201","last_deep_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.932043+0000","objects_scrubbed":56,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:52:53.830915+0000","scrub_duration":0.040909213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:37.263559+0000","last_change":"2023-11-19T00:42:37.263593+0000","last_active":"2023-11-19T00:42:37.263559+0000","last_peered":"2023-11-19T00:42:37.263559+0000","last_clean":"2023-11-19T00:42:37.263559+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:42:37.263559+0000","last_undegraded":"2023-11-19T00:42:37.263559+0000","last_fullsized":"2023-11-19T00:42:37.263559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'2","last_scrub_stamp":"2023-11-19T00:42:37.263440+0000","last_deep_scrub":"51'2","last_deep_scrub_stamp":"2023-11-19T00:42:37.263440+0000","last_clean_scrub_stamp":"2023-11-19T00:42:37.263440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:39:37.303438+0000","scrub_duration":0.002021194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"75'214","reported_seq":293,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:30.325146+0000","last_change":"2023-11-19T00:42:30.325172+0000","last_active":"2023-11-19T00:42:30.325146+0000","last_peered":"2023-11-19T00:42:30.325146+0000","last_clean":"2023-11-19T00:42:30.325146+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:42:30.325146+0000","last_undegraded":"2023-11-19T00:42:30.325146+0000","last_fullsized":"2023-11-19T00:42:30.325146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'214","last_scrub_stamp":"2023-11-19T00:42:30.325071+0000","last_deep_scrub":"75'214","last_deep_scrub_stamp":"2023-11-19T00:42:30.325071+0000","last_clean_scrub_stamp":"2023-11-19T00:42:30.325071+0000","objects_scrubbed":54,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:00:24.833086+0000","scrub_duration":0.034972046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"75'24","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.195410+0000","last_change":"2023-11-19T00:41:26.195438+0000","last_active":"2023-11-19T00:41:26.195410+0000","last_peered":"2023-11-19T00:41:26.195410+0000","last_clean":"2023-11-19T00:41:26.195410+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:41:26.195410+0000","last_undegraded":"2023-11-19T00:41:26.195410+0000","last_fullsized":"2023-11-19T00:41:26.195410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'24","last_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_deep_scrub":"75'24","last_deep_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.195316+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:42.215791+0000","scrub_duration":0.010042868999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"75'237","reported_seq":550,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:31.880355+0000","last_change":"2023-11-19T00:41:31.880416+0000","last_active":"2023-11-19T00:41:31.880355+0000","last_peered":"2023-11-19T00:41:31.880355+0000","last_clean":"2023-11-19T00:41:31.880355+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:41:31.880355+0000","last_undegraded":"2023-11-19T00:41:31.880355+0000","last_fullsized":"2023-11-19T00:41:31.880355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'237","last_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_deep_scrub":"75'237","last_deep_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_clean_scrub_stamp":"2023-11-19T00:41:31.880270+0000","objects_scrubbed":63,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:45:07.860358+0000","scrub_duration":0.045259584999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:49.280558+0000","last_change":"2023-11-19T00:42:49.280580+0000","last_active":"2023-11-19T00:42:49.280558+0000","last_peered":"2023-11-19T00:42:49.280558+0000","last_clean":"2023-11-19T00:42:49.280558+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:42:49.280558+0000","last_undegraded":"2023-11-19T00:42:49.280558+0000","last_fullsized":"2023-11-19T00:42:49.280558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:49.280472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:49.280472+0000","last_clean_scrub_stamp":"2023-11-19T00:42:49.280472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:56:42.053406+0000","scrub_duration":0.00185114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"75'220","reported_seq":303,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.223699+0000","last_change":"2023-11-19T00:42:17.223729+0000","last_active":"2023-11-19T00:42:17.223699+0000","last_peered":"2023-11-19T00:42:17.223699+0000","last_clean":"2023-11-19T00:42:17.223699+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:42:17.223699+0000","last_undegraded":"2023-11-19T00:42:17.223699+0000","last_fullsized":"2023-11-19T00:42:17.223699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.223626+0000","objects_scrubbed":60,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:53.070995+0000","scrub_duration":0.040470229000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:28.830332+0000","last_change":"2023-11-19T00:42:28.830355+0000","last_active":"2023-11-19T00:42:28.830332+0000","last_peered":"2023-11-19T00:42:28.830332+0000","last_clean":"2023-11-19T00:42:28.830332+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:42:28.830332+0000","last_undegraded":"2023-11-19T00:42:28.830332+0000","last_fullsized":"2023-11-19T00:42:28.830332+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:42:28.830245+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:42:28.830245+0000","last_clean_scrub_stamp":"2023-11-19T00:42:28.830245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:19.916978+0000","scrub_duration":0.001594212,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"75'186","reported_seq":632,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.036628+0000","last_change":"2023-11-19T00:41:50.036692+0000","last_active":"2023-11-19T00:41:50.036628+0000","last_peered":"2023-11-19T00:41:50.036628+0000","last_clean":"2023-11-19T00:41:50.036628+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:41:50.036628+0000","last_undegraded":"2023-11-19T00:41:50.036628+0000","last_fullsized":"2023-11-19T00:41:50.036628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.036536+0000","objects_scrubbed":49,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:16.564983+0000","scrub_duration":0.040848061999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:35.937090+0000","last_change":"2023-11-19T00:42:35.937090+0000","last_active":"2023-11-19T00:42:35.937090+0000","last_peered":"2023-11-19T00:42:35.937090+0000","last_clean":"2023-11-19T00:42:35.937090+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:42:35.937090+0000","last_undegraded":"2023-11-19T00:42:35.937090+0000","last_fullsized":"2023-11-19T00:42:35.937090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'1","last_scrub_stamp":"2023-11-19T00:42:35.936973+0000","last_deep_scrub":"47'1","last_deep_scrub_stamp":"2023-11-19T00:42:35.936973+0000","last_clean_scrub_stamp":"2023-11-19T00:42:35.936973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:07:24.029638+0000","scrub_duration":0.001736455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"75'193","reported_seq":272,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.356161+0000","last_change":"2023-11-19T00:41:36.356189+0000","last_active":"2023-11-19T00:41:36.356161+0000","last_peered":"2023-11-19T00:41:36.356161+0000","last_clean":"2023-11-19T00:41:36.356161+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:41:36.356161+0000","last_undegraded":"2023-11-19T00:41:36.356161+0000","last_fullsized":"2023-11-19T00:41:36.356161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'193","last_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_deep_scrub":"75'193","last_deep_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.356083+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:24.448748+0000","scrub_duration":0.035468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"75'159","reported_seq":318,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:00.102757+0000","last_change":"2023-11-19T00:42:00.102757+0000","last_active":"2023-11-19T00:42:00.102757+0000","last_peered":"2023-11-19T00:42:00.102757+0000","last_clean":"2023-11-19T00:42:00.102757+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:42:00.102757+0000","last_undegraded":"2023-11-19T00:42:00.102757+0000","last_fullsized":"2023-11-19T00:42:00.102757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'159","last_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_deep_scrub":"75'159","last_deep_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_clean_scrub_stamp":"2023-11-19T00:42:00.102649+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:42.477629+0000","scrub_duration":0.0046503730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:40.256201+0000","last_change":"2023-11-19T00:42:40.256201+0000","last_active":"2023-11-19T00:42:40.256201+0000","last_peered":"2023-11-19T00:42:40.256201+0000","last_clean":"2023-11-19T00:42:40.256201+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:42:40.256201+0000","last_undegraded":"2023-11-19T00:42:40.256201+0000","last_fullsized":"2023-11-19T00:42:40.256201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:40.256102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:40.256102+0000","last_clean_scrub_stamp":"2023-11-19T00:42:40.256102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:08.896709+0000","scrub_duration":0.0019289000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.188035+0000","last_change":"2023-11-19T00:42:20.188057+0000","last_active":"2023-11-19T00:42:20.188035+0000","last_peered":"2023-11-19T00:42:20.188035+0000","last_clean":"2023-11-19T00:42:20.188035+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:42:20.188035+0000","last_undegraded":"2023-11-19T00:42:20.188035+0000","last_fullsized":"2023-11-19T00:42:20.188035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'1","last_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_deep_scrub":"43'1","last_deep_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.187953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:45.835355+0000","scrub_duration":0.0019880190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"75'199","reported_seq":499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:26.278230+0000","last_change":"2023-11-19T00:42:26.278230+0000","last_active":"2023-11-19T00:42:26.278230+0000","last_peered":"2023-11-19T00:42:26.278230+0000","last_clean":"2023-11-19T00:42:26.278230+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:42:26.278230+0000","last_undegraded":"2023-11-19T00:42:26.278230+0000","last_fullsized":"2023-11-19T00:42:26.278230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:42:26.278125+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:42:26.278125+0000","last_clean_scrub_stamp":"2023-11-19T00:42:26.278125+0000","objects_scrubbed":60,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:16:35.526070+0000","scrub_duration":0.040067627000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.198576+0000","last_change":"2023-11-19T00:42:05.198576+0000","last_active":"2023-11-19T00:42:05.198576+0000","last_peered":"2023-11-19T00:42:05.198576+0000","last_clean":"2023-11-19T00:42:05.198576+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:42:05.198576+0000","last_undegraded":"2023-11-19T00:42:05.198576+0000","last_fullsized":"2023-11-19T00:42:05.198576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.198443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:02.651958+0000","scrub_duration":0.0016848690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"75'35","reported_seq":147,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:57.368492+0000","last_change":"2023-11-19T00:41:57.368492+0000","last_active":"2023-11-19T00:41:57.368492+0000","last_peered":"2023-11-19T00:41:57.368492+0000","last_clean":"2023-11-19T00:41:57.368492+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:41:57.368492+0000","last_undegraded":"2023-11-19T00:41:57.368492+0000","last_fullsized":"2023-11-19T00:41:57.368492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'35","last_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_deep_scrub":"75'35","last_deep_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_clean_scrub_stamp":"2023-11-19T00:41:57.368388+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:31.784985+0000","scrub_duration":0.0040954440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"75'208","reported_seq":718,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.122122+0000","last_change":"2023-11-19T00:41:07.122147+0000","last_active":"2023-11-19T00:41:07.122122+0000","last_peered":"2023-11-19T00:41:07.122122+0000","last_clean":"2023-11-19T00:41:07.122122+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:41:07.122122+0000","last_undegraded":"2023-11-19T00:41:07.122122+0000","last_fullsized":"2023-11-19T00:41:07.122122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'208","last_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_deep_scrub":"75'208","last_deep_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.122048+0000","objects_scrubbed":53,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:15.227402+0000","scrub_duration":0.037815080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.379498+0000","last_change":"2023-11-19T00:41:55.379498+0000","last_active":"2023-11-19T00:41:55.379498+0000","last_peered":"2023-11-19T00:41:55.379498+0000","last_clean":"2023-11-19T00:41:55.379498+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:41:55.379498+0000","last_undegraded":"2023-11-19T00:41:55.379498+0000","last_fullsized":"2023-11-19T00:41:55.379498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.379368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:42.997475+0000","scrub_duration":0.0022750370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"75'60","reported_seq":143,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.966258+0000","last_change":"2023-11-19T00:41:35.966258+0000","last_active":"2023-11-19T00:41:35.966258+0000","last_peered":"2023-11-19T00:41:35.966258+0000","last_clean":"2023-11-19T00:41:35.966258+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:41:35.966258+0000","last_undegraded":"2023-11-19T00:41:35.966258+0000","last_fullsized":"2023-11-19T00:41:35.966258+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.966137+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:39.525924+0000","scrub_duration":0.010289223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"59'160","reported_seq":680,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:40:58.634147+0000","last_change":"2023-11-19T00:40:50.631868+0000","last_active":"2023-11-19T00:40:58.634147+0000","last_peered":"2023-11-19T00:40:58.634147+0000","last_clean":"2023-11-19T00:40:58.634147+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:40:58.634147+0000","last_undegraded":"2023-11-19T00:40:58.634147+0000","last_fullsized":"2023-11-19T00:40:58.634147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:38:43.756866+0000","last_clean_scrub_stamp":"2023-11-19T00:38:43.756866+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:44.289875+0000","last_change":"2023-11-19T00:42:44.289875+0000","last_active":"2023-11-19T00:42:44.289875+0000","last_peered":"2023-11-19T00:42:44.289875+0000","last_clean":"2023-11-19T00:42:44.289875+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:42:44.289875+0000","last_undegraded":"2023-11-19T00:42:44.289875+0000","last_fullsized":"2023-11-19T00:42:44.289875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:44.289774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:44.289774+0000","last_clean_scrub_stamp":"2023-11-19T00:42:44.289774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:23:11.415326+0000","scrub_duration":0.0015282570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:32.180679+0000","last_change":"2023-11-19T00:42:32.180679+0000","last_active":"2023-11-19T00:42:32.180679+0000","last_peered":"2023-11-19T00:42:32.180679+0000","last_clean":"2023-11-19T00:42:32.180679+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:42:32.180679+0000","last_undegraded":"2023-11-19T00:42:32.180679+0000","last_fullsized":"2023-11-19T00:42:32.180679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:32.180559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:32.180559+0000","last_clean_scrub_stamp":"2023-11-19T00:42:32.180559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:03.912458+0000","scrub_duration":0.0023940770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"75'212","reported_seq":521,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:56.316093+0000","last_change":"2023-11-19T00:42:56.316143+0000","last_active":"2023-11-19T00:42:56.316093+0000","last_peered":"2023-11-19T00:42:56.316093+0000","last_clean":"2023-11-19T00:42:56.316093+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:42:56.316093+0000","last_undegraded":"2023-11-19T00:42:56.316093+0000","last_fullsized":"2023-11-19T00:42:56.316093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'212","last_scrub_stamp":"2023-11-19T00:42:56.315999+0000","last_deep_scrub":"75'212","last_deep_scrub_stamp":"2023-11-19T00:42:56.315999+0000","last_clean_scrub_stamp":"2023-11-19T00:42:56.315999+0000","objects_scrubbed":54,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:46:49.715715+0000","scrub_duration":0.037143185000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:13.930804+0000","last_change":"2023-11-19T00:41:13.930804+0000","last_active":"2023-11-19T00:41:13.930804+0000","last_peered":"2023-11-19T00:41:13.930804+0000","last_clean":"2023-11-19T00:41:13.930804+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:41:13.930804+0000","last_undegraded":"2023-11-19T00:41:13.930804+0000","last_fullsized":"2023-11-19T00:41:13.930804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_clean_scrub_stamp":"2023-11-19T00:41:13.930701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:52.200874+0000","scrub_duration":0.001907448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.394178+0000","last_change":"2023-11-19T00:41:03.394178+0000","last_active":"2023-11-19T00:41:03.394178+0000","last_peered":"2023-11-19T00:41:03.394178+0000","last_clean":"2023-11-19T00:41:03.394178+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:41:03.394178+0000","last_undegraded":"2023-11-19T00:41:03.394178+0000","last_fullsized":"2023-11-19T00:41:03.394178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.394072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:55:33.909806+0000","scrub_duration":0.0022610909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"75'200","reported_seq":301,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:39.901680+0000","last_change":"2023-11-19T00:42:39.901680+0000","last_active":"2023-11-19T00:42:39.901680+0000","last_peered":"2023-11-19T00:42:39.901680+0000","last_clean":"2023-11-19T00:42:39.901680+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:42:39.901680+0000","last_undegraded":"2023-11-19T00:42:39.901680+0000","last_fullsized":"2023-11-19T00:42:39.901680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:39.901536+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:39.901536+0000","last_clean_scrub_stamp":"2023-11-19T00:42:39.901536+0000","objects_scrubbed":49,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:21.315367+0000","scrub_duration":0.032113575999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:02.407245+0000","last_change":"2023-11-19T00:41:02.407245+0000","last_active":"2023-11-19T00:41:02.407245+0000","last_peered":"2023-11-19T00:41:02.407245+0000","last_clean":"2023-11-19T00:41:02.407245+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:41:02.407245+0000","last_undegraded":"2023-11-19T00:41:02.407245+0000","last_fullsized":"2023-11-19T00:41:02.407245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_clean_scrub_stamp":"2023-11-19T00:41:02.407143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:08:56.907868+0000","scrub_duration":0.001710039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.946932+0000","last_change":"2023-11-19T00:41:50.946932+0000","last_active":"2023-11-19T00:41:50.946932+0000","last_peered":"2023-11-19T00:41:50.946932+0000","last_clean":"2023-11-19T00:41:50.946932+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:41:50.946932+0000","last_undegraded":"2023-11-19T00:41:50.946932+0000","last_fullsized":"2023-11-19T00:41:50.946932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.946825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:53:57.831781+0000","scrub_duration":0.001540832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"75'222","reported_seq":305,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.964280+0000","last_change":"2023-11-19T00:42:17.964280+0000","last_active":"2023-11-19T00:42:17.964280+0000","last_peered":"2023-11-19T00:42:17.964280+0000","last_clean":"2023-11-19T00:42:17.964280+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:42:17.964280+0000","last_undegraded":"2023-11-19T00:42:17.964280+0000","last_fullsized":"2023-11-19T00:42:17.964280+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'222","last_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_deep_scrub":"75'222","last_deep_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.964152+0000","objects_scrubbed":45,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:56.501645+0000","scrub_duration":0.030415533000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"75'3","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:01.281804+0000","last_change":"2023-11-19T00:42:01.281847+0000","last_active":"2023-11-19T00:42:01.281804+0000","last_peered":"2023-11-19T00:42:01.281804+0000","last_clean":"2023-11-19T00:42:01.281804+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:42:01.281804+0000","last_undegraded":"2023-11-19T00:42:01.281804+0000","last_fullsized":"2023-11-19T00:42:01.281804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_clean_scrub_stamp":"2023-11-19T00:42:01.281689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:43.656669+0000","scrub_duration":0.003362435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:33.306598+0000","last_change":"2023-11-19T00:41:33.306598+0000","last_active":"2023-11-19T00:41:33.306598+0000","last_peered":"2023-11-19T00:41:33.306598+0000","last_clean":"2023-11-19T00:41:33.306598+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:41:33.306598+0000","last_undegraded":"2023-11-19T00:41:33.306598+0000","last_fullsized":"2023-11-19T00:41:33.306598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_clean_scrub_stamp":"2023-11-19T00:41:33.306492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:54:35.500265+0000","scrub_duration":0.0019877990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"75'227","reported_seq":292,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:44.248346+0000","last_change":"2023-11-19T00:42:44.248346+0000","last_active":"2023-11-19T00:42:44.248346+0000","last_peered":"2023-11-19T00:42:44.248346+0000","last_clean":"2023-11-19T00:42:44.248346+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:42:44.248346+0000","last_undegraded":"2023-11-19T00:42:44.248346+0000","last_fullsized":"2023-11-19T00:42:44.248346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'227","last_scrub_stamp":"2023-11-19T00:42:44.248229+0000","last_deep_scrub":"75'227","last_deep_scrub_stamp":"2023-11-19T00:42:44.248229+0000","last_clean_scrub_stamp":"2023-11-19T00:42:44.248229+0000","objects_scrubbed":57,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:16.253840+0000","scrub_duration":0.040383757999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"75'13","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.359724+0000","last_change":"2023-11-19T00:41:39.359724+0000","last_active":"2023-11-19T00:41:39.359724+0000","last_peered":"2023-11-19T00:41:39.359724+0000","last_clean":"2023-11-19T00:41:39.359724+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:41:39.359724+0000","last_undegraded":"2023-11-19T00:41:39.359724+0000","last_fullsized":"2023-11-19T00:41:39.359724+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'13","last_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_deep_scrub":"75'13","last_deep_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.359569+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:28.035657+0000","scrub_duration":0.0044493909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:18.983296+0000","last_change":"2023-11-19T00:41:18.983296+0000","last_active":"2023-11-19T00:41:18.983296+0000","last_peered":"2023-11-19T00:41:18.983296+0000","last_clean":"2023-11-19T00:41:18.983296+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:41:18.983296+0000","last_undegraded":"2023-11-19T00:41:18.983296+0000","last_fullsized":"2023-11-19T00:41:18.983296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_clean_scrub_stamp":"2023-11-19T00:41:18.983139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:41.254459+0000","scrub_duration":0.002267593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"75'186","reported_seq":285,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:32.952330+0000","last_change":"2023-11-19T00:41:32.952330+0000","last_active":"2023-11-19T00:41:32.952330+0000","last_peered":"2023-11-19T00:41:32.952330+0000","last_clean":"2023-11-19T00:41:32.952330+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:41:32.952330+0000","last_undegraded":"2023-11-19T00:41:32.952330+0000","last_fullsized":"2023-11-19T00:41:32.952330+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_clean_scrub_stamp":"2023-11-19T00:41:32.952223+0000","objects_scrubbed":51,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:14.957145+0000","scrub_duration":0.037260673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"75'218","reported_seq":519,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:25.289015+0000","last_change":"2023-11-19T00:42:25.289056+0000","last_active":"2023-11-19T00:42:25.289015+0000","last_peered":"2023-11-19T00:42:25.289015+0000","last_clean":"2023-11-19T00:42:25.289015+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:42:25.289015+0000","last_undegraded":"2023-11-19T00:42:25.289015+0000","last_fullsized":"2023-11-19T00:42:25.289015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'218","last_scrub_stamp":"2023-11-19T00:42:25.288919+0000","last_deep_scrub":"75'218","last_deep_scrub_stamp":"2023-11-19T00:42:25.288919+0000","last_clean_scrub_stamp":"2023-11-19T00:42:25.288919+0000","objects_scrubbed":50,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:12.971024+0000","scrub_duration":0.040409217999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"75'46","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:34.879339+0000","last_change":"2023-11-19T00:41:34.879370+0000","last_active":"2023-11-19T00:41:34.879339+0000","last_peered":"2023-11-19T00:41:34.879339+0000","last_clean":"2023-11-19T00:41:34.879339+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:41:34.879339+0000","last_undegraded":"2023-11-19T00:41:34.879339+0000","last_fullsized":"2023-11-19T00:41:34.879339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_clean_scrub_stamp":"2023-11-19T00:41:34.879255+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:29.054637+0000","scrub_duration":0.011582451000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"75'200","reported_seq":684,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:36.272713+0000","last_change":"2023-11-19T00:42:36.272763+0000","last_active":"2023-11-19T00:42:36.272713+0000","last_peered":"2023-11-19T00:42:36.272713+0000","last_clean":"2023-11-19T00:42:36.272713+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:42:36.272713+0000","last_undegraded":"2023-11-19T00:42:36.272713+0000","last_fullsized":"2023-11-19T00:42:36.272713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:36.272626+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:36.272626+0000","last_clean_scrub_stamp":"2023-11-19T00:42:36.272626+0000","objects_scrubbed":46,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:23.954732+0000","scrub_duration":0.031714834999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"75'21","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.005846+0000","last_change":"2023-11-19T00:41:35.005876+0000","last_active":"2023-11-19T00:41:35.005846+0000","last_peered":"2023-11-19T00:41:35.005846+0000","last_clean":"2023-11-19T00:41:35.005846+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:41:35.005846+0000","last_undegraded":"2023-11-19T00:41:35.005846+0000","last_fullsized":"2023-11-19T00:41:35.005846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'21","last_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_deep_scrub":"75'21","last_deep_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.005745+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:31:58.190130+0000","scrub_duration":0.0037074590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:49.033609+0000","last_change":"2023-11-19T00:41:49.033646+0000","last_active":"2023-11-19T00:41:49.033609+0000","last_peered":"2023-11-19T00:41:49.033609+0000","last_clean":"2023-11-19T00:41:49.033609+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:41:49.033609+0000","last_undegraded":"2023-11-19T00:41:49.033609+0000","last_fullsized":"2023-11-19T00:41:49.033609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_clean_scrub_stamp":"2023-11-19T00:41:49.033509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:09.818062+0000","scrub_duration":0.0016660780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"75'231","reported_seq":310,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:22.189106+0000","last_change":"2023-11-19T00:42:22.189147+0000","last_active":"2023-11-19T00:42:22.189106+0000","last_peered":"2023-11-19T00:42:22.189106+0000","last_clean":"2023-11-19T00:42:22.189106+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:42:22.189106+0000","last_undegraded":"2023-11-19T00:42:22.189106+0000","last_fullsized":"2023-11-19T00:42:22.189106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:42:22.189028+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:42:22.189028+0000","last_clean_scrub_stamp":"2023-11-19T00:42:22.189028+0000","objects_scrubbed":61,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:01.634373+0000","scrub_duration":0.042413226999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.247582+0000","last_change":"2023-11-19T00:42:07.247621+0000","last_active":"2023-11-19T00:42:07.247582+0000","last_peered":"2023-11-19T00:42:07.247582+0000","last_clean":"2023-11-19T00:42:07.247582+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:42:07.247582+0000","last_undegraded":"2023-11-19T00:42:07.247582+0000","last_fullsized":"2023-11-19T00:42:07.247582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.247482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:43.797824+0000","scrub_duration":0.0013240540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"75'209","reported_seq":507,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:47.308610+0000","last_change":"2023-11-19T00:42:47.308659+0000","last_active":"2023-11-19T00:42:47.308610+0000","last_peered":"2023-11-19T00:42:47.308610+0000","last_clean":"2023-11-19T00:42:47.308610+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:42:47.308610+0000","last_undegraded":"2023-11-19T00:42:47.308610+0000","last_fullsized":"2023-11-19T00:42:47.308610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'209","last_scrub_stamp":"2023-11-19T00:42:47.308479+0000","last_deep_scrub":"75'209","last_deep_scrub_stamp":"2023-11-19T00:42:47.308479+0000","last_clean_scrub_stamp":"2023-11-19T00:42:47.308479+0000","objects_scrubbed":54,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:21.586844+0000","scrub_duration":0.037357785999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'219","reported_seq":308,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.954366+0000","last_change":"2023-11-19T00:42:02.954366+0000","last_active":"2023-11-19T00:42:02.954366+0000","last_peered":"2023-11-19T00:42:02.954366+0000","last_clean":"2023-11-19T00:42:02.954366+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:42:02.954366+0000","last_undegraded":"2023-11-19T00:42:02.954366+0000","last_fullsized":"2023-11-19T00:42:02.954366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'219","last_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_deep_scrub":"75'219","last_deep_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.954261+0000","objects_scrubbed":56,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:04.790371+0000","scrub_duration":0.040234886999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:44.366153+0000","last_change":"2023-11-19T00:41:44.366204+0000","last_active":"2023-11-19T00:41:44.366153+0000","last_peered":"2023-11-19T00:41:44.366153+0000","last_clean":"2023-11-19T00:41:44.366153+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:41:44.366153+0000","last_undegraded":"2023-11-19T00:41:44.366153+0000","last_fullsized":"2023-11-19T00:41:44.366153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'1","last_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_deep_scrub":"45'1","last_deep_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_clean_scrub_stamp":"2023-11-19T00:41:44.366059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:07:42.639601+0000","scrub_duration":0.001898725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"75'202","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:19.306669+0000","last_change":"2023-11-19T00:41:19.306669+0000","last_active":"2023-11-19T00:41:19.306669+0000","last_peered":"2023-11-19T00:41:19.306669+0000","last_clean":"2023-11-19T00:41:19.306669+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:41:19.306669+0000","last_undegraded":"2023-11-19T00:41:19.306669+0000","last_fullsized":"2023-11-19T00:41:19.306669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'202","last_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_deep_scrub":"75'202","last_deep_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:19.306536+0000","objects_scrubbed":49,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:17.124610+0000","scrub_duration":0.034907383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:06.281328+0000","last_change":"2023-11-19T00:41:06.281350+0000","last_active":"2023-11-19T00:41:06.281328+0000","last_peered":"2023-11-19T00:41:06.281328+0000","last_clean":"2023-11-19T00:41:06.281328+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:41:06.281328+0000","last_undegraded":"2023-11-19T00:41:06.281328+0000","last_fullsized":"2023-11-19T00:41:06.281328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_clean_scrub_stamp":"2023-11-19T00:41:06.281244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:23.140955+0000","scrub_duration":0.0017497389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"75'211","reported_seq":297,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:27.901382+0000","last_change":"2023-11-19T00:42:27.901444+0000","last_active":"2023-11-19T00:42:27.901382+0000","last_peered":"2023-11-19T00:42:27.901382+0000","last_clean":"2023-11-19T00:42:27.901382+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:42:27.901382+0000","last_undegraded":"2023-11-19T00:42:27.901382+0000","last_fullsized":"2023-11-19T00:42:27.901382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:42:27.901274+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:42:27.901274+0000","last_clean_scrub_stamp":"2023-11-19T00:42:27.901274+0000","objects_scrubbed":48,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:14.699783+0000","scrub_duration":0.037691249000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"75'6","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:34.899826+0000","last_change":"2023-11-19T00:42:34.899885+0000","last_active":"2023-11-19T00:42:34.899826+0000","last_peered":"2023-11-19T00:42:34.899826+0000","last_clean":"2023-11-19T00:42:34.899826+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:42:34.899826+0000","last_undegraded":"2023-11-19T00:42:34.899826+0000","last_fullsized":"2023-11-19T00:42:34.899826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2023-11-19T00:42:34.899734+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2023-11-19T00:42:34.899734+0000","last_clean_scrub_stamp":"2023-11-19T00:42:34.899734+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:39:28.534968+0000","scrub_duration":0.0089668409999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"75'220","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.986982+0000","last_change":"2023-11-19T00:41:15.986982+0000","last_active":"2023-11-19T00:41:15.986982+0000","last_peered":"2023-11-19T00:41:15.986982+0000","last_clean":"2023-11-19T00:41:15.986982+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:41:15.986982+0000","last_undegraded":"2023-11-19T00:41:15.986982+0000","last_fullsized":"2023-11-19T00:41:15.986982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.986886+0000","objects_scrubbed":53,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:40.565603+0000","scrub_duration":0.036034849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"75'7","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:29.949945+0000","last_change":"2023-11-19T00:41:29.949973+0000","last_active":"2023-11-19T00:41:29.949945+0000","last_peered":"2023-11-19T00:41:29.949945+0000","last_clean":"2023-11-19T00:41:29.949945+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:41:29.949945+0000","last_undegraded":"2023-11-19T00:41:29.949945+0000","last_fullsized":"2023-11-19T00:41:29.949945+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'7","last_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_deep_scrub":"75'7","last_deep_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_clean_scrub_stamp":"2023-11-19T00:41:29.949858+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:16:37.535582+0000","scrub_duration":0.009494878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"75'207","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.229246+0000","last_change":"2023-11-19T00:42:02.229284+0000","last_active":"2023-11-19T00:42:02.229246+0000","last_peered":"2023-11-19T00:42:02.229246+0000","last_clean":"2023-11-19T00:42:02.229246+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:42:02.229246+0000","last_undegraded":"2023-11-19T00:42:02.229246+0000","last_fullsized":"2023-11-19T00:42:02.229246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.229170+0000","objects_scrubbed":66,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:38.779512+0000","scrub_duration":0.044979045000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"75'3","reported_seq":90,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:31.202683+0000","last_change":"2023-11-19T00:42:31.202710+0000","last_active":"2023-11-19T00:42:31.202683+0000","last_peered":"2023-11-19T00:42:31.202683+0000","last_clean":"2023-11-19T00:42:31.202683+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:42:31.202683+0000","last_undegraded":"2023-11-19T00:42:31.202683+0000","last_fullsized":"2023-11-19T00:42:31.202683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:31.202607+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:31.202607+0000","last_clean_scrub_stamp":"2023-11-19T00:42:31.202607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:59.375894+0000","scrub_duration":0.003221341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"75'213","reported_seq":276,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:42.308706+0000","last_change":"2023-11-19T00:42:42.308732+0000","last_active":"2023-11-19T00:42:42.308706+0000","last_peered":"2023-11-19T00:42:42.308706+0000","last_clean":"2023-11-19T00:42:42.308706+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:42:42.308706+0000","last_undegraded":"2023-11-19T00:42:42.308706+0000","last_fullsized":"2023-11-19T00:42:42.308706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:42:42.308635+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:42:42.308635+0000","last_clean_scrub_stamp":"2023-11-19T00:42:42.308635+0000","objects_scrubbed":52,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:07:33.586799+0000","scrub_duration":0.035823174999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"75'56","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.925143+0000","last_change":"2023-11-19T00:41:48.925171+0000","last_active":"2023-11-19T00:41:48.925143+0000","last_peered":"2023-11-19T00:41:48.925143+0000","last_clean":"2023-11-19T00:41:48.925143+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:41:48.925143+0000","last_undegraded":"2023-11-19T00:41:48.925143+0000","last_fullsized":"2023-11-19T00:41:48.925143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'56","last_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_deep_scrub":"75'56","last_deep_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.925067+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:26:37.416531+0000","scrub_duration":0.016421860999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"75'228","reported_seq":543,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.083829+0000","last_change":"2023-11-19T00:41:04.083863+0000","last_active":"2023-11-19T00:41:04.083829+0000","last_peered":"2023-11-19T00:41:04.083829+0000","last_clean":"2023-11-19T00:41:04.083829+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:41:04.083829+0000","last_undegraded":"2023-11-19T00:41:04.083829+0000","last_fullsized":"2023-11-19T00:41:04.083829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'228","last_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_deep_scrub":"75'228","last_deep_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.083754+0000","objects_scrubbed":57,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:04:56.786572+0000","scrub_duration":0.039326976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"75'3","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.242967+0000","last_change":"2023-11-19T00:42:13.242967+0000","last_active":"2023-11-19T00:42:13.242967+0000","last_peered":"2023-11-19T00:42:13.242967+0000","last_clean":"2023-11-19T00:42:13.242967+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:42:13.242967+0000","last_undegraded":"2023-11-19T00:42:13.242967+0000","last_fullsized":"2023-11-19T00:42:13.242967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.242851+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:19.880790+0000","scrub_duration":0.0092839810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"75'254","reported_seq":579,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:45.012072+0000","last_change":"2023-11-19T00:41:45.012108+0000","last_active":"2023-11-19T00:41:45.012072+0000","last_peered":"2023-11-19T00:41:45.012072+0000","last_clean":"2023-11-19T00:41:45.012072+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:41:45.012072+0000","last_undegraded":"2023-11-19T00:41:45.012072+0000","last_fullsized":"2023-11-19T00:41:45.012072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'254","last_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_deep_scrub":"75'254","last_deep_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_clean_scrub_stamp":"2023-11-19T00:41:45.011994+0000","objects_scrubbed":64,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:03.705015+0000","scrub_duration":0.043843721000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"75'18","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:11.205737+0000","last_change":"2023-11-19T00:41:11.205737+0000","last_active":"2023-11-19T00:41:11.205737+0000","last_peered":"2023-11-19T00:41:11.205737+0000","last_clean":"2023-11-19T00:41:11.205737+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:41:11.205737+0000","last_undegraded":"2023-11-19T00:41:11.205737+0000","last_fullsized":"2023-11-19T00:41:11.205737+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'18","last_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_deep_scrub":"75'18","last_deep_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_clean_scrub_stamp":"2023-11-19T00:41:11.205579+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:37.711995+0000","scrub_duration":0.010464658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13616,"ondisk_log_size":13616,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":464,"ondisk_log_size":464,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90672,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94281168,"statfs":{"total":96636764160,"available":96543916032,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.33100000000000002,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.29799999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.32100000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.40600000000000003}]}]},{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110068,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94261772,"statfs":{"total":96636764160,"available":96524054528,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.253,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.68400000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.441},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.47399999999999998},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Nov 19 00:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45400000000000001,"15min":0.46999999999999997},"min":{"1min":0.32000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.622,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.48799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104964,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94266876,"statfs":{"total":96636764160,"available":96529281024,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.23300000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.55900000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.27100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58699999999999997,"5min":0.625,"15min":0.625},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Nov 19 00:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.436,"15min":0.44700000000000001},"min":{"1min":0.32500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.62},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.439,"15min":0.443},"min":{"1min":0.29099999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:43:03.868 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-19T00:38:43.756866+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=38, tm_sec=43, tm_wday=6, tm_yday=323, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=19, tm_hour=0, tm_min=40, tm_sec=59, tm_wday=6, tm_yday=323, tm_isdst=0) 2023-11-19T00:43:03.868 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-19T00:43:23.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-19T00:43:24.181 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:43:24.183 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-11-19T00:43:24.193 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-11-19T00:43:23.086232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67852784,"num_objects":3480,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3480,"num_whiteouts":0,"num_read":169,"num_read_kb":451,"num_write":11025,"num_write_kb":82484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5406,"num_bytes_recovered":42225688,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14300,"ondisk_log_size":14300,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":305704,"kb_used_data":153872,"kb_used_omap":4,"kb_used_meta":151803,"kb_avail":282809816,"statfs":{"total":289910292480,"available":289597251584,"internally_reserved":0,"allocated":157564928,"data_stored":136311516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":155446607},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003492"},"pg_stats":[{"pgid":"4.3f","version":"75'215","reported_seq":512,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.015195+0000","last_change":"2023-11-19T00:41:12.015195+0000","last_active":"2023-11-19T00:41:12.015195+0000","last_peered":"2023-11-19T00:41:12.015195+0000","last_clean":"2023-11-19T00:41:12.015195+0000","last_became_active":"2023-11-19T00:40:47.641846+0000","last_became_peered":"2023-11-19T00:40:47.641846+0000","last_unstale":"2023-11-19T00:41:12.015195+0000","last_undegraded":"2023-11-19T00:41:12.015195+0000","last_fullsized":"2023-11-19T00:41:12.015195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:12.015097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.015097+0000","objects_scrubbed":50,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:41:27.053797+0000","scrub_duration":0.036690850999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220185,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":440336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"75'207","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:04.947449+0000","last_change":"2023-11-19T00:42:04.947449+0000","last_active":"2023-11-19T00:42:04.947449+0000","last_peered":"2023-11-19T00:42:04.947449+0000","last_clean":"2023-11-19T00:42:04.947449+0000","last_became_active":"2023-11-19T00:40:47.639913+0000","last_became_peered":"2023-11-19T00:40:47.639913+0000","last_unstale":"2023-11-19T00:42:04.947449+0000","last_undegraded":"2023-11-19T00:42:04.947449+0000","last_fullsized":"2023-11-19T00:42:04.947449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:04.947330+0000","last_clean_scrub_stamp":"2023-11-19T00:42:04.947330+0000","objects_scrubbed":45,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:45:23.142624+0000","scrub_duration":0.031262616999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":334884,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"75'207","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.223244+0000","last_change":"2023-11-19T00:42:13.223244+0000","last_active":"2023-11-19T00:42:13.223244+0000","last_peered":"2023-11-19T00:42:13.223244+0000","last_clean":"2023-11-19T00:42:13.223244+0000","last_became_active":"2023-11-19T00:40:49.639199+0000","last_became_peered":"2023-11-19T00:40:49.639199+0000","last_unstale":"2023-11-19T00:42:13.223244+0000","last_undegraded":"2023-11-19T00:42:13.223244+0000","last_fullsized":"2023-11-19T00:42:13.223244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:13.223119+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.223119+0000","objects_scrubbed":39,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:01:18.136942+0000","scrub_duration":0.027099018999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201756,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"75'172","reported_seq":233,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:10.950107+0000","last_change":"2023-11-19T00:41:10.950107+0000","last_active":"2023-11-19T00:41:10.950107+0000","last_peered":"2023-11-19T00:41:10.950107+0000","last_clean":"2023-11-19T00:41:10.950107+0000","last_became_active":"2023-11-19T00:40:49.647736+0000","last_became_peered":"2023-11-19T00:40:49.647736+0000","last_unstale":"2023-11-19T00:41:10.950107+0000","last_undegraded":"2023-11-19T00:41:10.950107+0000","last_fullsized":"2023-11-19T00:41:10.950107+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'172","last_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_deep_scrub":"75'172","last_deep_scrub_stamp":"2023-11-19T00:41:10.950010+0000","last_clean_scrub_stamp":"2023-11-19T00:41:10.950010+0000","objects_scrubbed":51,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:03.687754+0000","scrub_duration":0.034903271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133784,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"75'236","reported_seq":574,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:50.813773+0000","last_change":"2023-11-19T00:42:50.813773+0000","last_active":"2023-11-19T00:42:50.813773+0000","last_peered":"2023-11-19T00:42:50.813773+0000","last_clean":"2023-11-19T00:42:50.813773+0000","last_became_active":"2023-11-19T00:40:50.630898+0000","last_became_peered":"2023-11-19T00:40:50.630898+0000","last_unstale":"2023-11-19T00:42:50.813773+0000","last_undegraded":"2023-11-19T00:42:50.813773+0000","last_fullsized":"2023-11-19T00:42:50.813773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'236","last_scrub_stamp":"2023-11-19T00:42:50.813607+0000","last_deep_scrub":"75'236","last_deep_scrub_stamp":"2023-11-19T00:42:50.813607+0000","last_clean_scrub_stamp":"2023-11-19T00:42:50.813607+0000","objects_scrubbed":65,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:26:11.598161+0000","scrub_duration":0.045240623000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":360608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"75'221","reported_seq":519,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:29.297602+0000","last_change":"2023-11-19T00:42:29.297650+0000","last_active":"2023-11-19T00:42:29.297602+0000","last_peered":"2023-11-19T00:42:29.297602+0000","last_clean":"2023-11-19T00:42:29.297602+0000","last_became_active":"2023-11-19T00:40:49.648040+0000","last_became_peered":"2023-11-19T00:40:49.648040+0000","last_unstale":"2023-11-19T00:42:29.297602+0000","last_undegraded":"2023-11-19T00:42:29.297602+0000","last_fullsized":"2023-11-19T00:42:29.297602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:42:29.297503+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:42:29.297503+0000","last_clean_scrub_stamp":"2023-11-19T00:42:29.297503+0000","objects_scrubbed":55,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:50:20.920428+0000","scrub_duration":0.039328285999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":95590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"75'227","reported_seq":290,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:41.910516+0000","last_change":"2023-11-19T00:41:41.910554+0000","last_active":"2023-11-19T00:41:41.910516+0000","last_peered":"2023-11-19T00:41:41.910516+0000","last_clean":"2023-11-19T00:41:41.910516+0000","last_became_active":"2023-11-19T00:40:49.643342+0000","last_became_peered":"2023-11-19T00:40:49.643342+0000","last_unstale":"2023-11-19T00:41:41.910516+0000","last_undegraded":"2023-11-19T00:41:41.910516+0000","last_fullsized":"2023-11-19T00:41:41.910516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'227","last_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_deep_scrub":"75'227","last_deep_scrub_stamp":"2023-11-19T00:41:41.910446+0000","last_clean_scrub_stamp":"2023-11-19T00:41:41.910446+0000","objects_scrubbed":62,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:52.519112+0000","scrub_duration":0.043757361000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111886,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"75'179","reported_seq":426,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.949857+0000","last_change":"2023-11-19T00:41:36.949897+0000","last_active":"2023-11-19T00:41:36.949857+0000","last_peered":"2023-11-19T00:41:36.949857+0000","last_clean":"2023-11-19T00:41:36.949857+0000","last_became_active":"2023-11-19T00:40:49.644062+0000","last_became_peered":"2023-11-19T00:40:49.644062+0000","last_unstale":"2023-11-19T00:41:36.949857+0000","last_undegraded":"2023-11-19T00:41:36.949857+0000","last_fullsized":"2023-11-19T00:41:36.949857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'179","last_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_deep_scrub":"75'179","last_deep_scrub_stamp":"2023-11-19T00:41:36.949768+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.949768+0000","objects_scrubbed":48,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:56:32.130529+0000","scrub_duration":0.033692611999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":109683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"75'220","reported_seq":299,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.238253+0000","last_change":"2023-11-19T00:41:08.238253+0000","last_active":"2023-11-19T00:41:08.238253+0000","last_peered":"2023-11-19T00:41:08.238253+0000","last_clean":"2023-11-19T00:41:08.238253+0000","last_became_active":"2023-11-19T00:38:44.775874+0000","last_became_peered":"2023-11-19T00:38:44.775874+0000","last_unstale":"2023-11-19T00:41:08.238253+0000","last_undegraded":"2023-11-19T00:41:08.238253+0000","last_fullsized":"2023-11-19T00:41:08.238253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:08.238154+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.238154+0000","objects_scrubbed":51,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:28:28.657653+0000","scrub_duration":0.035756160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74127,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"75'197","reported_seq":471,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:40.870564+0000","last_change":"2023-11-19T00:42:40.870564+0000","last_active":"2023-11-19T00:42:40.870564+0000","last_peered":"2023-11-19T00:42:40.870564+0000","last_clean":"2023-11-19T00:42:40.870564+0000","last_became_active":"2023-11-19T00:40:49.644040+0000","last_became_peered":"2023-11-19T00:40:49.644040+0000","last_unstale":"2023-11-19T00:42:40.870564+0000","last_undegraded":"2023-11-19T00:42:40.870564+0000","last_fullsized":"2023-11-19T00:42:40.870564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'197","last_scrub_stamp":"2023-11-19T00:42:40.870444+0000","last_deep_scrub":"75'197","last_deep_scrub_stamp":"2023-11-19T00:42:40.870444+0000","last_clean_scrub_stamp":"2023-11-19T00:42:40.870444+0000","objects_scrubbed":49,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:58:51.479110+0000","scrub_duration":0.031404438999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68823,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":133984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"75'215","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.969246+0000","last_change":"2023-11-19T00:41:15.969271+0000","last_active":"2023-11-19T00:41:15.969246+0000","last_peered":"2023-11-19T00:41:15.969246+0000","last_clean":"2023-11-19T00:41:15.969246+0000","last_became_active":"2023-11-19T00:40:49.643302+0000","last_became_peered":"2023-11-19T00:40:49.643302+0000","last_unstale":"2023-11-19T00:41:15.969246+0000","last_undegraded":"2023-11-19T00:41:15.969246+0000","last_fullsized":"2023-11-19T00:41:15.969246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'215","last_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_deep_scrub":"75'215","last_deep_scrub_stamp":"2023-11-19T00:41:15.969180+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.969180+0000","objects_scrubbed":56,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:37:03.160511+0000","scrub_duration":0.046149739000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610076,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":604715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"75'191","reported_seq":277,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.898049+0000","last_change":"2023-11-19T00:42:20.898107+0000","last_active":"2023-11-19T00:42:20.898049+0000","last_peered":"2023-11-19T00:42:20.898049+0000","last_clean":"2023-11-19T00:42:20.898049+0000","last_became_active":"2023-11-19T00:40:25.678799+0000","last_became_peered":"2023-11-19T00:40:25.678799+0000","last_unstale":"2023-11-19T00:42:20.898049+0000","last_undegraded":"2023-11-19T00:42:20.898049+0000","last_fullsized":"2023-11-19T00:42:20.898049+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'191","last_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_deep_scrub":"75'191","last_deep_scrub_stamp":"2023-11-19T00:42:20.897961+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.897961+0000","objects_scrubbed":55,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:22:41.542056+0000","scrub_duration":0.041092573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278121,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"75'183","reported_seq":633,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:09.037113+0000","last_change":"2023-11-19T00:41:09.037113+0000","last_active":"2023-11-19T00:41:09.037113+0000","last_peered":"2023-11-19T00:41:09.037113+0000","last_clean":"2023-11-19T00:41:09.037113+0000","last_became_active":"2023-11-19T00:40:47.639882+0000","last_became_peered":"2023-11-19T00:40:47.639882+0000","last_unstale":"2023-11-19T00:41:09.037113+0000","last_undegraded":"2023-11-19T00:41:09.037113+0000","last_fullsized":"2023-11-19T00:41:09.037113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'183","last_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_deep_scrub":"75'183","last_deep_scrub_stamp":"2023-11-19T00:41:09.037014+0000","last_clean_scrub_stamp":"2023-11-19T00:41:09.037014+0000","objects_scrubbed":50,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:32:26.814001+0000","scrub_duration":0.033302804999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126621,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":333927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"75'224","reported_seq":724,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:52.995941+0000","last_change":"2023-11-19T00:41:52.995980+0000","last_active":"2023-11-19T00:41:52.995941+0000","last_peered":"2023-11-19T00:41:52.995941+0000","last_clean":"2023-11-19T00:41:52.995941+0000","last_became_active":"2023-11-19T00:40:49.637575+0000","last_became_peered":"2023-11-19T00:40:49.637575+0000","last_unstale":"2023-11-19T00:41:52.995941+0000","last_undegraded":"2023-11-19T00:41:52.995941+0000","last_fullsized":"2023-11-19T00:41:52.995941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'224","last_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_deep_scrub":"75'224","last_deep_scrub_stamp":"2023-11-19T00:41:52.995854+0000","last_clean_scrub_stamp":"2023-11-19T00:41:52.995854+0000","objects_scrubbed":44,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:27.412450+0000","scrub_duration":0.030047951999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78475,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":156950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"75'206","reported_seq":289,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.250517+0000","last_change":"2023-11-19T00:42:07.250542+0000","last_active":"2023-11-19T00:42:07.250517+0000","last_peered":"2023-11-19T00:42:07.250517+0000","last_clean":"2023-11-19T00:42:07.250517+0000","last_became_active":"2023-11-19T00:40:49.632701+0000","last_became_peered":"2023-11-19T00:40:49.632701+0000","last_unstale":"2023-11-19T00:42:07.250517+0000","last_undegraded":"2023-11-19T00:42:07.250517+0000","last_fullsized":"2023-11-19T00:42:07.250517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:42:07.250444+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.250444+0000","objects_scrubbed":50,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:41:30.400474+0000","scrub_duration":0.034619200000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144045,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"75'231","reported_seq":298,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:51.008109+0000","last_change":"2023-11-19T00:41:51.008143+0000","last_active":"2023-11-19T00:41:51.008109+0000","last_peered":"2023-11-19T00:41:51.008109+0000","last_clean":"2023-11-19T00:41:51.008109+0000","last_became_active":"2023-11-19T00:40:49.645012+0000","last_became_peered":"2023-11-19T00:40:49.645012+0000","last_unstale":"2023-11-19T00:41:51.008109+0000","last_undegraded":"2023-11-19T00:41:51.008109+0000","last_fullsized":"2023-11-19T00:41:51.008109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:41:51.008026+0000","last_clean_scrub_stamp":"2023-11-19T00:41:51.008026+0000","objects_scrubbed":58,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:38.626133+0000","scrub_duration":0.041732172999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465313,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"75'207","reported_seq":286,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.461743+0000","last_change":"2023-11-19T00:41:48.461784+0000","last_active":"2023-11-19T00:41:48.461743+0000","last_peered":"2023-11-19T00:41:48.461743+0000","last_clean":"2023-11-19T00:41:48.461743+0000","last_became_active":"2023-11-19T00:38:44.770653+0000","last_became_peered":"2023-11-19T00:38:44.770653+0000","last_unstale":"2023-11-19T00:41:48.461743+0000","last_undegraded":"2023-11-19T00:41:48.461743+0000","last_fullsized":"2023-11-19T00:41:48.461743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:41:48.461644+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.461644+0000","objects_scrubbed":53,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:30:42.739782+0000","scrub_duration":0.045335093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"75'199","reported_seq":484,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.090862+0000","last_change":"2023-11-19T00:41:03.090862+0000","last_active":"2023-11-19T00:41:03.090862+0000","last_peered":"2023-11-19T00:41:03.090862+0000","last_clean":"2023-11-19T00:41:03.090862+0000","last_became_active":"2023-11-19T00:40:47.641264+0000","last_became_peered":"2023-11-19T00:40:47.641264+0000","last_unstale":"2023-11-19T00:41:03.090862+0000","last_undegraded":"2023-11-19T00:41:03.090862+0000","last_fullsized":"2023-11-19T00:41:03.090862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:41:03.090716+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.090716+0000","objects_scrubbed":47,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:54:42.528537+0000","scrub_duration":0.045074112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4324129,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4303193,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"75'196","reported_seq":479,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:33.311118+0000","last_change":"2023-11-19T00:42:33.311118+0000","last_active":"2023-11-19T00:42:33.311118+0000","last_peered":"2023-11-19T00:42:33.311118+0000","last_clean":"2023-11-19T00:42:33.311118+0000","last_became_active":"2023-11-19T00:40:47.636432+0000","last_became_peered":"2023-11-19T00:40:47.636432+0000","last_unstale":"2023-11-19T00:42:33.311118+0000","last_undegraded":"2023-11-19T00:42:33.311118+0000","last_fullsized":"2023-11-19T00:42:33.311118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'196","last_scrub_stamp":"2023-11-19T00:42:33.310988+0000","last_deep_scrub":"75'196","last_deep_scrub_stamp":"2023-11-19T00:42:33.310988+0000","last_clean_scrub_stamp":"2023-11-19T00:42:33.310988+0000","objects_scrubbed":51,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:20.855882+0000","scrub_duration":0.041832331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190712,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":381424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"75'221","reported_seq":282,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.963623+0000","last_change":"2023-11-19T00:41:04.963623+0000","last_active":"2023-11-19T00:41:04.963623+0000","last_peered":"2023-11-19T00:41:04.963623+0000","last_clean":"2023-11-19T00:41:04.963623+0000","last_became_active":"2023-11-19T00:40:49.648313+0000","last_became_peered":"2023-11-19T00:40:49.648313+0000","last_unstale":"2023-11-19T00:41:04.963623+0000","last_undegraded":"2023-11-19T00:41:04.963623+0000","last_fullsized":"2023-11-19T00:41:04.963623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:41:04.963516+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.963516+0000","objects_scrubbed":56,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:06.799626+0000","scrub_duration":0.039865746000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78498,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"75'217","reported_seq":276,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:12.942606+0000","last_change":"2023-11-19T00:41:12.942606+0000","last_active":"2023-11-19T00:41:12.942606+0000","last_peered":"2023-11-19T00:41:12.942606+0000","last_clean":"2023-11-19T00:41:12.942606+0000","last_became_active":"2023-11-19T00:40:49.646978+0000","last_became_peered":"2023-11-19T00:40:49.646978+0000","last_unstale":"2023-11-19T00:41:12.942606+0000","last_undegraded":"2023-11-19T00:41:12.942606+0000","last_fullsized":"2023-11-19T00:41:12.942606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'217","last_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_deep_scrub":"75'217","last_deep_scrub_stamp":"2023-11-19T00:41:12.942504+0000","last_clean_scrub_stamp":"2023-11-19T00:41:12.942504+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:29.802215+0000","scrub_duration":0.042793523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119505,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"75'220","reported_seq":300,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:10.027942+0000","last_change":"2023-11-19T00:42:10.027942+0000","last_active":"2023-11-19T00:42:10.027942+0000","last_peered":"2023-11-19T00:42:10.027942+0000","last_clean":"2023-11-19T00:42:10.027942+0000","last_became_active":"2023-11-19T00:38:44.776377+0000","last_became_peered":"2023-11-19T00:38:44.776377+0000","last_unstale":"2023-11-19T00:42:10.027942+0000","last_undegraded":"2023-11-19T00:42:10.027942+0000","last_fullsized":"2023-11-19T00:42:10.027942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:10.027812+0000","last_clean_scrub_stamp":"2023-11-19T00:42:10.027812+0000","objects_scrubbed":54,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:56:40.543546+0000","scrub_duration":0.042942501000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271393,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"75'211","reported_seq":291,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.392777+0000","last_change":"2023-11-19T00:41:42.392777+0000","last_active":"2023-11-19T00:41:42.392777+0000","last_peered":"2023-11-19T00:41:42.392777+0000","last_clean":"2023-11-19T00:41:42.392777+0000","last_became_active":"2023-11-19T00:38:44.777260+0000","last_became_peered":"2023-11-19T00:38:44.777260+0000","last_unstale":"2023-11-19T00:41:42.392777+0000","last_undegraded":"2023-11-19T00:41:42.392777+0000","last_fullsized":"2023-11-19T00:41:42.392777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:41:42.392663+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.392663+0000","objects_scrubbed":60,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:23.806495+0000","scrub_duration":0.040785126999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225814,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"75'212","reported_seq":277,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:36.921989+0000","last_change":"2023-11-19T00:42:36.921989+0000","last_active":"2023-11-19T00:42:36.921989+0000","last_peered":"2023-11-19T00:42:36.921989+0000","last_clean":"2023-11-19T00:42:36.921989+0000","last_became_active":"2023-11-19T00:40:47.644589+0000","last_became_peered":"2023-11-19T00:40:47.644589+0000","last_unstale":"2023-11-19T00:42:36.921989+0000","last_undegraded":"2023-11-19T00:42:36.921989+0000","last_fullsized":"2023-11-19T00:42:36.921989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'212","last_scrub_stamp":"2023-11-19T00:42:36.921879+0000","last_deep_scrub":"75'212","last_deep_scrub_stamp":"2023-11-19T00:42:36.921879+0000","last_clean_scrub_stamp":"2023-11-19T00:42:36.921879+0000","objects_scrubbed":49,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:17:25.597966+0000","scrub_duration":0.031590009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155159,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"75'213","reported_seq":313,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.957022+0000","last_change":"2023-11-19T00:41:26.957022+0000","last_active":"2023-11-19T00:41:26.957022+0000","last_peered":"2023-11-19T00:41:26.957022+0000","last_clean":"2023-11-19T00:41:26.957022+0000","last_became_active":"2023-11-19T00:40:36.674099+0000","last_became_peered":"2023-11-19T00:40:36.674099+0000","last_unstale":"2023-11-19T00:41:26.957022+0000","last_undegraded":"2023-11-19T00:41:26.957022+0000","last_fullsized":"2023-11-19T00:41:26.957022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:41:26.956876+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.956876+0000","objects_scrubbed":53,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:31:00.258795+0000","scrub_duration":0.041573285000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813759,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":806697,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"75'246","reported_seq":326,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:30.252904+0000","last_change":"2023-11-19T00:41:30.252904+0000","last_active":"2023-11-19T00:41:30.252904+0000","last_peered":"2023-11-19T00:41:30.252904+0000","last_clean":"2023-11-19T00:41:30.252904+0000","last_became_active":"2023-11-19T00:38:44.772213+0000","last_became_peered":"2023-11-19T00:38:44.772213+0000","last_unstale":"2023-11-19T00:41:30.252904+0000","last_undegraded":"2023-11-19T00:41:30.252904+0000","last_fullsized":"2023-11-19T00:41:30.252904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'246","last_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_deep_scrub":"75'246","last_deep_scrub_stamp":"2023-11-19T00:41:30.252803+0000","last_clean_scrub_stamp":"2023-11-19T00:41:30.252803+0000","objects_scrubbed":61,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:05:30.610485+0000","scrub_duration":0.045754178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129200,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"75'200","reported_seq":284,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.237917+0000","last_change":"2023-11-19T00:42:15.237917+0000","last_active":"2023-11-19T00:42:15.237917+0000","last_peered":"2023-11-19T00:42:15.237917+0000","last_clean":"2023-11-19T00:42:15.237917+0000","last_became_active":"2023-11-19T00:40:49.639144+0000","last_became_peered":"2023-11-19T00:40:49.639144+0000","last_unstale":"2023-11-19T00:42:15.237917+0000","last_undegraded":"2023-11-19T00:42:15.237917+0000","last_fullsized":"2023-11-19T00:42:15.237917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:15.237806+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.237806+0000","objects_scrubbed":52,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:11:37.875363+0000","scrub_duration":0.035472484999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389370,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"75'195","reported_seq":294,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:14.991861+0000","last_change":"2023-11-19T00:41:14.991861+0000","last_active":"2023-11-19T00:41:14.991861+0000","last_peered":"2023-11-19T00:41:14.991861+0000","last_clean":"2023-11-19T00:41:14.991861+0000","last_became_active":"2023-11-19T00:40:37.681808+0000","last_became_peered":"2023-11-19T00:40:37.681808+0000","last_unstale":"2023-11-19T00:41:14.991861+0000","last_undegraded":"2023-11-19T00:41:14.991861+0000","last_fullsized":"2023-11-19T00:41:14.991861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'195","last_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_deep_scrub":"75'195","last_deep_scrub_stamp":"2023-11-19T00:41:14.991747+0000","last_clean_scrub_stamp":"2023-11-19T00:41:14.991747+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:33.385240+0000","scrub_duration":0.031971732000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117117,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":117117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"75'224","reported_seq":744,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:58.356612+0000","last_change":"2023-11-19T00:42:58.356612+0000","last_active":"2023-11-19T00:42:58.356612+0000","last_peered":"2023-11-19T00:42:58.356612+0000","last_clean":"2023-11-19T00:42:58.356612+0000","last_became_active":"2023-11-19T00:40:50.630820+0000","last_became_peered":"2023-11-19T00:40:50.630820+0000","last_unstale":"2023-11-19T00:42:58.356612+0000","last_undegraded":"2023-11-19T00:42:58.356612+0000","last_fullsized":"2023-11-19T00:42:58.356612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'224","last_scrub_stamp":"2023-11-19T00:42:58.356491+0000","last_deep_scrub":"75'224","last_deep_scrub_stamp":"2023-11-19T00:42:58.356491+0000","last_clean_scrub_stamp":"2023-11-19T00:42:58.356491+0000","objects_scrubbed":64,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:53.238401+0000","scrub_duration":0.051649353000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4315189,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8630090,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"75'253","reported_seq":343,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:29.855731+0000","last_change":"2023-11-19T00:42:29.855731+0000","last_active":"2023-11-19T00:42:29.855731+0000","last_peered":"2023-11-19T00:42:29.855731+0000","last_clean":"2023-11-19T00:42:29.855731+0000","last_became_active":"2023-11-19T00:40:25.678492+0000","last_became_peered":"2023-11-19T00:40:25.678492+0000","last_unstale":"2023-11-19T00:42:29.855731+0000","last_undegraded":"2023-11-19T00:42:29.855731+0000","last_fullsized":"2023-11-19T00:42:29.855731+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'253","last_scrub_stamp":"2023-11-19T00:42:29.855630+0000","last_deep_scrub":"75'253","last_deep_scrub_stamp":"2023-11-19T00:42:29.855630+0000","last_clean_scrub_stamp":"2023-11-19T00:42:29.855630+0000","objects_scrubbed":64,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:08:46.808688+0000","scrub_duration":0.046923685999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322589,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"75'255","reported_seq":843,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:34.351762+0000","last_change":"2023-11-19T00:42:34.351762+0000","last_active":"2023-11-19T00:42:34.351762+0000","last_peered":"2023-11-19T00:42:34.351762+0000","last_clean":"2023-11-19T00:42:34.351762+0000","last_became_active":"2023-11-19T00:40:49.631709+0000","last_became_peered":"2023-11-19T00:40:49.631709+0000","last_unstale":"2023-11-19T00:42:34.351762+0000","last_undegraded":"2023-11-19T00:42:34.351762+0000","last_fullsized":"2023-11-19T00:42:34.351762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'255","last_scrub_stamp":"2023-11-19T00:42:34.351651+0000","last_deep_scrub":"75'255","last_deep_scrub_stamp":"2023-11-19T00:42:34.351651+0000","last_clean_scrub_stamp":"2023-11-19T00:42:34.351651+0000","objects_scrubbed":61,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:28:06.035302+0000","scrub_duration":0.041563124999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97290,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":194580,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"75'234","reported_seq":294,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.033234+0000","last_change":"2023-11-19T00:41:55.033234+0000","last_active":"2023-11-19T00:41:55.033234+0000","last_peered":"2023-11-19T00:41:55.033234+0000","last_clean":"2023-11-19T00:41:55.033234+0000","last_became_active":"2023-11-19T00:40:49.644678+0000","last_became_peered":"2023-11-19T00:40:49.644678+0000","last_unstale":"2023-11-19T00:41:55.033234+0000","last_undegraded":"2023-11-19T00:41:55.033234+0000","last_fullsized":"2023-11-19T00:41:55.033234+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'234","last_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_deep_scrub":"75'234","last_deep_scrub_stamp":"2023-11-19T00:41:55.033097+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.033097+0000","objects_scrubbed":50,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:01.427989+0000","scrub_duration":0.036056435999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491601,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"75'189","reported_seq":466,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:51.813882+0000","last_change":"2023-11-19T00:42:51.813882+0000","last_active":"2023-11-19T00:42:51.813882+0000","last_peered":"2023-11-19T00:42:51.813882+0000","last_clean":"2023-11-19T00:42:51.813882+0000","last_became_active":"2023-11-19T00:40:50.630878+0000","last_became_peered":"2023-11-19T00:40:50.630878+0000","last_unstale":"2023-11-19T00:42:51.813882+0000","last_undegraded":"2023-11-19T00:42:51.813882+0000","last_fullsized":"2023-11-19T00:42:51.813882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'189","last_scrub_stamp":"2023-11-19T00:42:51.813782+0000","last_deep_scrub":"75'189","last_deep_scrub_stamp":"2023-11-19T00:42:51.813782+0000","last_clean_scrub_stamp":"2023-11-19T00:42:51.813782+0000","objects_scrubbed":51,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:18.342230+0000","scrub_duration":0.035874337999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194068,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":388136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"75'140","reported_seq":224,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:08.861697+0000","last_change":"2023-11-19T00:41:08.861726+0000","last_active":"2023-11-19T00:41:08.861697+0000","last_peered":"2023-11-19T00:41:08.861697+0000","last_clean":"2023-11-19T00:41:08.861697+0000","last_became_active":"2023-11-19T00:40:49.647941+0000","last_became_peered":"2023-11-19T00:40:49.647941+0000","last_unstale":"2023-11-19T00:41:08.861697+0000","last_undegraded":"2023-11-19T00:41:08.861697+0000","last_fullsized":"2023-11-19T00:41:08.861697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'140","last_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_deep_scrub":"75'140","last_deep_scrub_stamp":"2023-11-19T00:41:08.861626+0000","last_clean_scrub_stamp":"2023-11-19T00:41:08.861626+0000","objects_scrubbed":3,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:28:02.346222+0000","scrub_duration":0.0096612360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981524,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":2986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"75'238","reported_seq":524,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:46.783590+0000","last_change":"2023-11-19T00:42:46.783590+0000","last_active":"2023-11-19T00:42:46.783590+0000","last_peered":"2023-11-19T00:42:46.783590+0000","last_clean":"2023-11-19T00:42:46.783590+0000","last_became_active":"2023-11-19T00:40:49.631127+0000","last_became_peered":"2023-11-19T00:40:49.631127+0000","last_unstale":"2023-11-19T00:42:46.783590+0000","last_undegraded":"2023-11-19T00:42:46.783590+0000","last_fullsized":"2023-11-19T00:42:46.783590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'238","last_scrub_stamp":"2023-11-19T00:42:46.783480+0000","last_deep_scrub":"75'238","last_deep_scrub_stamp":"2023-11-19T00:42:46.783480+0000","last_clean_scrub_stamp":"2023-11-19T00:42:46.783480+0000","objects_scrubbed":41,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:31:41.061618+0000","scrub_duration":0.028011919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58610,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":117220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"44'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:58.324049+0000","last_change":"2023-11-19T00:41:58.324092+0000","last_active":"2023-11-19T00:41:58.324049+0000","last_peered":"2023-11-19T00:41:58.324049+0000","last_clean":"2023-11-19T00:41:58.324049+0000","last_became_active":"2023-11-19T00:38:43.772654+0000","last_became_peered":"2023-11-19T00:38:43.772654+0000","last_unstale":"2023-11-19T00:41:58.324049+0000","last_undegraded":"2023-11-19T00:41:58.324049+0000","last_fullsized":"2023-11-19T00:41:58.324049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:41:58.323959+0000","last_clean_scrub_stamp":"2023-11-19T00:41:58.323959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:12:04.718851+0000","scrub_duration":0.0018957519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'236","reported_seq":315,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:53.485524+0000","last_change":"2023-11-19T00:41:53.485557+0000","last_active":"2023-11-19T00:41:53.485524+0000","last_peered":"2023-11-19T00:41:53.485524+0000","last_clean":"2023-11-19T00:41:53.485524+0000","last_became_active":"2023-11-19T00:38:44.772316+0000","last_became_peered":"2023-11-19T00:38:44.772316+0000","last_unstale":"2023-11-19T00:41:53.485524+0000","last_undegraded":"2023-11-19T00:41:53.485524+0000","last_fullsized":"2023-11-19T00:41:53.485524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'236","last_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_deep_scrub":"75'236","last_deep_scrub_stamp":"2023-11-19T00:41:53.485439+0000","last_clean_scrub_stamp":"2023-11-19T00:41:53.485439+0000","objects_scrubbed":63,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:20.013886+0000","scrub_duration":0.043385156000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395458,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:19.896895+0000","last_change":"2023-11-19T00:42:19.896917+0000","last_active":"2023-11-19T00:42:19.896895+0000","last_peered":"2023-11-19T00:42:19.896895+0000","last_clean":"2023-11-19T00:42:19.896895+0000","last_became_active":"2023-11-19T00:40:25.678419+0000","last_became_peered":"2023-11-19T00:40:25.678419+0000","last_unstale":"2023-11-19T00:42:19.896895+0000","last_undegraded":"2023-11-19T00:42:19.896895+0000","last_fullsized":"2023-11-19T00:42:19.896895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:19.896803+0000","last_clean_scrub_stamp":"2023-11-19T00:42:19.896803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:36:46.403219+0000","scrub_duration":0.0019930909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"75'206","reported_seq":275,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.456322+0000","last_change":"2023-11-19T00:41:50.456322+0000","last_active":"2023-11-19T00:41:50.456322+0000","last_peered":"2023-11-19T00:41:50.456322+0000","last_clean":"2023-11-19T00:41:50.456322+0000","last_became_active":"2023-11-19T00:40:47.625872+0000","last_became_peered":"2023-11-19T00:40:47.625872+0000","last_unstale":"2023-11-19T00:41:50.456322+0000","last_undegraded":"2023-11-19T00:41:50.456322+0000","last_fullsized":"2023-11-19T00:41:50.456322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'206","last_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_deep_scrub":"75'206","last_deep_scrub_stamp":"2023-11-19T00:41:50.456210+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.456210+0000","objects_scrubbed":54,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:50:56.340582+0000","scrub_duration":0.037720240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228569,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":220842,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"75'12","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:17.957067+0000","last_change":"2023-11-19T00:41:17.957098+0000","last_active":"2023-11-19T00:41:17.957067+0000","last_peered":"2023-11-19T00:41:17.957067+0000","last_clean":"2023-11-19T00:41:17.957067+0000","last_became_active":"2023-11-19T00:40:49.637346+0000","last_became_peered":"2023-11-19T00:40:49.637346+0000","last_unstale":"2023-11-19T00:41:17.957067+0000","last_undegraded":"2023-11-19T00:41:17.957067+0000","last_fullsized":"2023-11-19T00:41:17.957067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2023-11-19T00:41:17.956986+0000","last_clean_scrub_stamp":"2023-11-19T00:41:17.956986+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:03:50.209311+0000","scrub_duration":0.0041360729999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"75'2","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.876223+0000","last_change":"2023-11-19T00:41:39.876223+0000","last_active":"2023-11-19T00:41:39.876223+0000","last_peered":"2023-11-19T00:41:39.876223+0000","last_clean":"2023-11-19T00:41:39.876223+0000","last_became_active":"2023-11-19T00:40:49.636084+0000","last_became_peered":"2023-11-19T00:40:49.636084+0000","last_unstale":"2023-11-19T00:41:39.876223+0000","last_undegraded":"2023-11-19T00:41:39.876223+0000","last_fullsized":"2023-11-19T00:41:39.876223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2023-11-19T00:41:39.876064+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.876064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:19:21.289896+0000","scrub_duration":0.0035587930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"75'211","reported_seq":301,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:15.930166+0000","last_change":"2023-11-19T00:42:15.930166+0000","last_active":"2023-11-19T00:42:15.930166+0000","last_peered":"2023-11-19T00:42:15.930166+0000","last_clean":"2023-11-19T00:42:15.930166+0000","last_became_active":"2023-11-19T00:40:25.678396+0000","last_became_peered":"2023-11-19T00:40:25.678396+0000","last_unstale":"2023-11-19T00:42:15.930166+0000","last_undegraded":"2023-11-19T00:42:15.930166+0000","last_fullsized":"2023-11-19T00:42:15.930166+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:42:15.930063+0000","last_clean_scrub_stamp":"2023-11-19T00:42:15.930063+0000","objects_scrubbed":52,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:39:54.200236+0000","scrub_duration":0.037878510999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198426,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"75'4","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.934099+0000","last_change":"2023-11-19T00:42:05.934099+0000","last_active":"2023-11-19T00:42:05.934099+0000","last_peered":"2023-11-19T00:42:05.934099+0000","last_clean":"2023-11-19T00:42:05.934099+0000","last_became_active":"2023-11-19T00:40:25.678297+0000","last_became_peered":"2023-11-19T00:40:25.678297+0000","last_unstale":"2023-11-19T00:42:05.934099+0000","last_undegraded":"2023-11-19T00:42:05.934099+0000","last_fullsized":"2023-11-19T00:42:05.934099+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2023-11-19T00:42:05.933982+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.933982+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:00:07.479529+0000","scrub_duration":0.0031029730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"75'225","reported_seq":541,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:42.058808+0000","last_change":"2023-11-19T00:41:42.058808+0000","last_active":"2023-11-19T00:41:42.058808+0000","last_peered":"2023-11-19T00:41:42.058808+0000","last_clean":"2023-11-19T00:41:42.058808+0000","last_became_active":"2023-11-19T00:40:47.638198+0000","last_became_peered":"2023-11-19T00:40:47.638198+0000","last_unstale":"2023-11-19T00:41:42.058808+0000","last_undegraded":"2023-11-19T00:41:42.058808+0000","last_fullsized":"2023-11-19T00:41:42.058808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'225","last_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_deep_scrub":"75'225","last_deep_scrub_stamp":"2023-11-19T00:41:42.058668+0000","last_clean_scrub_stamp":"2023-11-19T00:41:42.058668+0000","objects_scrubbed":58,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:50:08.830501+0000","scrub_duration":0.041143718000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490248,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":460239,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"75'3","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:21.190005+0000","last_change":"2023-11-19T00:42:21.190005+0000","last_active":"2023-11-19T00:42:21.190005+0000","last_peered":"2023-11-19T00:42:21.190005+0000","last_clean":"2023-11-19T00:42:21.190005+0000","last_became_active":"2023-11-19T00:40:49.636224+0000","last_became_peered":"2023-11-19T00:40:49.636224+0000","last_unstale":"2023-11-19T00:42:21.190005+0000","last_undegraded":"2023-11-19T00:42:21.190005+0000","last_fullsized":"2023-11-19T00:42:21.190005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:21.189891+0000","last_clean_scrub_stamp":"2023-11-19T00:42:21.189891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:08.734785+0000","scrub_duration":0.0034598979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"75'201","reported_seq":482,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.932168+0000","last_change":"2023-11-19T00:41:07.932168+0000","last_active":"2023-11-19T00:41:07.932168+0000","last_peered":"2023-11-19T00:41:07.932168+0000","last_clean":"2023-11-19T00:41:07.932168+0000","last_became_active":"2023-11-19T00:40:49.644802+0000","last_became_peered":"2023-11-19T00:40:49.644802+0000","last_unstale":"2023-11-19T00:41:07.932168+0000","last_undegraded":"2023-11-19T00:41:07.932168+0000","last_fullsized":"2023-11-19T00:41:07.932168+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'201","last_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_deep_scrub":"75'201","last_deep_scrub_stamp":"2023-11-19T00:41:07.932043+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.932043+0000","objects_scrubbed":56,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:52:53.830915+0000","scrub_duration":0.040909213999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101556,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":101556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:37.263593+0000","last_change":"2023-11-19T00:42:37.263593+0000","last_active":"2023-11-19T00:42:37.263593+0000","last_peered":"2023-11-19T00:42:37.263593+0000","last_clean":"2023-11-19T00:42:37.263593+0000","last_became_active":"2023-11-19T00:40:49.649140+0000","last_became_peered":"2023-11-19T00:40:49.649140+0000","last_unstale":"2023-11-19T00:42:37.263593+0000","last_undegraded":"2023-11-19T00:42:37.263593+0000","last_fullsized":"2023-11-19T00:42:37.263593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'2","last_scrub_stamp":"2023-11-19T00:42:37.263440+0000","last_deep_scrub":"51'2","last_deep_scrub_stamp":"2023-11-19T00:42:37.263440+0000","last_clean_scrub_stamp":"2023-11-19T00:42:37.263440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:39:37.303438+0000","scrub_duration":0.002021194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"75'214","reported_seq":294,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:30.325172+0000","last_change":"2023-11-19T00:42:30.325172+0000","last_active":"2023-11-19T00:42:30.325172+0000","last_peered":"2023-11-19T00:42:30.325172+0000","last_clean":"2023-11-19T00:42:30.325172+0000","last_became_active":"2023-11-19T00:38:44.773150+0000","last_became_peered":"2023-11-19T00:38:44.773150+0000","last_unstale":"2023-11-19T00:42:30.325172+0000","last_undegraded":"2023-11-19T00:42:30.325172+0000","last_fullsized":"2023-11-19T00:42:30.325172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'214","last_scrub_stamp":"2023-11-19T00:42:30.325071+0000","last_deep_scrub":"75'214","last_deep_scrub_stamp":"2023-11-19T00:42:30.325071+0000","last_clean_scrub_stamp":"2023-11-19T00:42:30.325071+0000","objects_scrubbed":54,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:00:24.833086+0000","scrub_duration":0.034972046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158925,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"75'24","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:26.195438+0000","last_change":"2023-11-19T00:41:26.195438+0000","last_active":"2023-11-19T00:41:26.195438+0000","last_peered":"2023-11-19T00:41:26.195438+0000","last_clean":"2023-11-19T00:41:26.195438+0000","last_became_active":"2023-11-19T00:40:44.705670+0000","last_became_peered":"2023-11-19T00:40:44.705670+0000","last_unstale":"2023-11-19T00:41:26.195438+0000","last_undegraded":"2023-11-19T00:41:26.195438+0000","last_fullsized":"2023-11-19T00:41:26.195438+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'24","last_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_deep_scrub":"75'24","last_deep_scrub_stamp":"2023-11-19T00:41:26.195316+0000","last_clean_scrub_stamp":"2023-11-19T00:41:26.195316+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:18:42.215791+0000","scrub_duration":0.010042868999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"75'237","reported_seq":551,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:31.880416+0000","last_change":"2023-11-19T00:41:31.880416+0000","last_active":"2023-11-19T00:41:31.880416+0000","last_peered":"2023-11-19T00:41:31.880416+0000","last_clean":"2023-11-19T00:41:31.880416+0000","last_became_active":"2023-11-19T00:40:49.647166+0000","last_became_peered":"2023-11-19T00:40:49.647166+0000","last_unstale":"2023-11-19T00:41:31.880416+0000","last_undegraded":"2023-11-19T00:41:31.880416+0000","last_fullsized":"2023-11-19T00:41:31.880416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'237","last_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_deep_scrub":"75'237","last_deep_scrub_stamp":"2023-11-19T00:41:31.880270+0000","last_clean_scrub_stamp":"2023-11-19T00:41:31.880270+0000","objects_scrubbed":63,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:45:07.860358+0000","scrub_duration":0.045259584999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515258,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":515258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:49.280580+0000","last_change":"2023-11-19T00:42:49.280580+0000","last_active":"2023-11-19T00:42:49.280580+0000","last_peered":"2023-11-19T00:42:49.280580+0000","last_clean":"2023-11-19T00:42:49.280580+0000","last_became_active":"2023-11-19T00:40:49.649178+0000","last_became_peered":"2023-11-19T00:40:49.649178+0000","last_unstale":"2023-11-19T00:42:49.280580+0000","last_undegraded":"2023-11-19T00:42:49.280580+0000","last_fullsized":"2023-11-19T00:42:49.280580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:49.280472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:49.280472+0000","last_clean_scrub_stamp":"2023-11-19T00:42:49.280472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:56:42.053406+0000","scrub_duration":0.00185114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"75'220","reported_seq":304,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.223729+0000","last_change":"2023-11-19T00:42:17.223729+0000","last_active":"2023-11-19T00:42:17.223729+0000","last_peered":"2023-11-19T00:42:17.223729+0000","last_clean":"2023-11-19T00:42:17.223729+0000","last_became_active":"2023-11-19T00:40:49.638068+0000","last_became_peered":"2023-11-19T00:40:49.638068+0000","last_unstale":"2023-11-19T00:42:17.223729+0000","last_undegraded":"2023-11-19T00:42:17.223729+0000","last_fullsized":"2023-11-19T00:42:17.223729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:42:17.223626+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.223626+0000","objects_scrubbed":60,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:57:53.070995+0000","scrub_duration":0.040470229000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180411,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"44'1","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:28.830355+0000","last_change":"2023-11-19T00:42:28.830355+0000","last_active":"2023-11-19T00:42:28.830355+0000","last_peered":"2023-11-19T00:42:28.830355+0000","last_clean":"2023-11-19T00:42:28.830355+0000","last_became_active":"2023-11-19T00:40:25.678482+0000","last_became_peered":"2023-11-19T00:40:25.678482+0000","last_unstale":"2023-11-19T00:42:28.830355+0000","last_undegraded":"2023-11-19T00:42:28.830355+0000","last_fullsized":"2023-11-19T00:42:28.830355+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2023-11-19T00:42:28.830245+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2023-11-19T00:42:28.830245+0000","last_clean_scrub_stamp":"2023-11-19T00:42:28.830245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:32:19.916978+0000","scrub_duration":0.001594212,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"75'186","reported_seq":633,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.036692+0000","last_change":"2023-11-19T00:41:50.036692+0000","last_active":"2023-11-19T00:41:50.036692+0000","last_peered":"2023-11-19T00:41:50.036692+0000","last_clean":"2023-11-19T00:41:50.036692+0000","last_became_active":"2023-11-19T00:40:49.635088+0000","last_became_peered":"2023-11-19T00:40:49.635088+0000","last_unstale":"2023-11-19T00:41:50.036692+0000","last_undegraded":"2023-11-19T00:41:50.036692+0000","last_fullsized":"2023-11-19T00:41:50.036692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:50.036536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.036536+0000","objects_scrubbed":49,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:31:16.564983+0000","scrub_duration":0.040848061999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305376,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":6610674,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"47'1","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:35.937090+0000","last_change":"2023-11-19T00:42:35.937090+0000","last_active":"2023-11-19T00:42:35.937090+0000","last_peered":"2023-11-19T00:42:35.937090+0000","last_clean":"2023-11-19T00:42:35.937090+0000","last_became_active":"2023-11-19T00:40:47.643516+0000","last_became_peered":"2023-11-19T00:40:47.643516+0000","last_unstale":"2023-11-19T00:42:35.937090+0000","last_undegraded":"2023-11-19T00:42:35.937090+0000","last_fullsized":"2023-11-19T00:42:35.937090+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'1","last_scrub_stamp":"2023-11-19T00:42:35.936973+0000","last_deep_scrub":"47'1","last_deep_scrub_stamp":"2023-11-19T00:42:35.936973+0000","last_clean_scrub_stamp":"2023-11-19T00:42:35.936973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:07:24.029638+0000","scrub_duration":0.001736455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"75'193","reported_seq":273,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:36.356189+0000","last_change":"2023-11-19T00:41:36.356189+0000","last_active":"2023-11-19T00:41:36.356189+0000","last_peered":"2023-11-19T00:41:36.356189+0000","last_clean":"2023-11-19T00:41:36.356189+0000","last_became_active":"2023-11-19T00:38:44.775214+0000","last_became_peered":"2023-11-19T00:38:44.775214+0000","last_unstale":"2023-11-19T00:41:36.356189+0000","last_undegraded":"2023-11-19T00:41:36.356189+0000","last_fullsized":"2023-11-19T00:41:36.356189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'193","last_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_deep_scrub":"75'193","last_deep_scrub_stamp":"2023-11-19T00:41:36.356083+0000","last_clean_scrub_stamp":"2023-11-19T00:41:36.356083+0000","objects_scrubbed":53,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:06:24.448748+0000","scrub_duration":0.035468840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"75'159","reported_seq":318,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:00.102757+0000","last_change":"2023-11-19T00:42:00.102757+0000","last_active":"2023-11-19T00:42:00.102757+0000","last_peered":"2023-11-19T00:42:00.102757+0000","last_clean":"2023-11-19T00:42:00.102757+0000","last_became_active":"2023-11-19T00:40:49.636720+0000","last_became_peered":"2023-11-19T00:40:49.636720+0000","last_unstale":"2023-11-19T00:42:00.102757+0000","last_undegraded":"2023-11-19T00:42:00.102757+0000","last_fullsized":"2023-11-19T00:42:00.102757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'159","last_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_deep_scrub":"75'159","last_deep_scrub_stamp":"2023-11-19T00:42:00.102649+0000","last_clean_scrub_stamp":"2023-11-19T00:42:00.102649+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:42.477629+0000","scrub_duration":0.0046503730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:40.256201+0000","last_change":"2023-11-19T00:42:40.256201+0000","last_active":"2023-11-19T00:42:40.256201+0000","last_peered":"2023-11-19T00:42:40.256201+0000","last_clean":"2023-11-19T00:42:40.256201+0000","last_became_active":"2023-11-19T00:40:49.648383+0000","last_became_peered":"2023-11-19T00:40:49.648383+0000","last_unstale":"2023-11-19T00:42:40.256201+0000","last_undegraded":"2023-11-19T00:42:40.256201+0000","last_fullsized":"2023-11-19T00:42:40.256201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:40.256102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:40.256102+0000","last_clean_scrub_stamp":"2023-11-19T00:42:40.256102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:08.896709+0000","scrub_duration":0.0019289000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"43'1","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:20.188035+0000","last_change":"2023-11-19T00:42:20.188057+0000","last_active":"2023-11-19T00:42:20.188035+0000","last_peered":"2023-11-19T00:42:20.188035+0000","last_clean":"2023-11-19T00:42:20.188035+0000","last_became_active":"2023-11-19T00:40:49.637490+0000","last_became_peered":"2023-11-19T00:40:49.637490+0000","last_unstale":"2023-11-19T00:42:20.188035+0000","last_undegraded":"2023-11-19T00:42:20.188035+0000","last_fullsized":"2023-11-19T00:42:20.188035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'1","last_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_deep_scrub":"43'1","last_deep_scrub_stamp":"2023-11-19T00:42:20.187953+0000","last_clean_scrub_stamp":"2023-11-19T00:42:20.187953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:15:45.835355+0000","scrub_duration":0.0019880190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"75'199","reported_seq":499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:26.278230+0000","last_change":"2023-11-19T00:42:26.278230+0000","last_active":"2023-11-19T00:42:26.278230+0000","last_peered":"2023-11-19T00:42:26.278230+0000","last_clean":"2023-11-19T00:42:26.278230+0000","last_became_active":"2023-11-19T00:40:49.638064+0000","last_became_peered":"2023-11-19T00:40:49.638064+0000","last_unstale":"2023-11-19T00:42:26.278230+0000","last_undegraded":"2023-11-19T00:42:26.278230+0000","last_fullsized":"2023-11-19T00:42:26.278230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'199","last_scrub_stamp":"2023-11-19T00:42:26.278125+0000","last_deep_scrub":"75'199","last_deep_scrub_stamp":"2023-11-19T00:42:26.278125+0000","last_clean_scrub_stamp":"2023-11-19T00:42:26.278125+0000","objects_scrubbed":60,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:16:35.526070+0000","scrub_duration":0.040067627000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96960,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":96960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:05.198576+0000","last_change":"2023-11-19T00:42:05.198576+0000","last_active":"2023-11-19T00:42:05.198576+0000","last_peered":"2023-11-19T00:42:05.198576+0000","last_clean":"2023-11-19T00:42:05.198576+0000","last_became_active":"2023-11-19T00:40:49.635627+0000","last_became_peered":"2023-11-19T00:40:49.635627+0000","last_unstale":"2023-11-19T00:42:05.198576+0000","last_undegraded":"2023-11-19T00:42:05.198576+0000","last_fullsized":"2023-11-19T00:42:05.198576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:05.198443+0000","last_clean_scrub_stamp":"2023-11-19T00:42:05.198443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:12:02.651958+0000","scrub_duration":0.0016848690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"75'35","reported_seq":147,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:57.368492+0000","last_change":"2023-11-19T00:41:57.368492+0000","last_active":"2023-11-19T00:41:57.368492+0000","last_peered":"2023-11-19T00:41:57.368492+0000","last_clean":"2023-11-19T00:41:57.368492+0000","last_became_active":"2023-11-19T00:38:43.772074+0000","last_became_peered":"2023-11-19T00:38:43.772074+0000","last_unstale":"2023-11-19T00:41:57.368492+0000","last_undegraded":"2023-11-19T00:41:57.368492+0000","last_fullsized":"2023-11-19T00:41:57.368492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'35","last_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_deep_scrub":"75'35","last_deep_scrub_stamp":"2023-11-19T00:41:57.368388+0000","last_clean_scrub_stamp":"2023-11-19T00:41:57.368388+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:46:31.784985+0000","scrub_duration":0.0040954440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318352,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":33,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"75'208","reported_seq":719,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:07.122147+0000","last_change":"2023-11-19T00:41:07.122147+0000","last_active":"2023-11-19T00:41:07.122147+0000","last_peered":"2023-11-19T00:41:07.122147+0000","last_clean":"2023-11-19T00:41:07.122147+0000","last_became_active":"2023-11-19T00:40:47.639381+0000","last_became_peered":"2023-11-19T00:40:47.639381+0000","last_unstale":"2023-11-19T00:41:07.122147+0000","last_undegraded":"2023-11-19T00:41:07.122147+0000","last_fullsized":"2023-11-19T00:41:07.122147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'208","last_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_deep_scrub":"75'208","last_deep_scrub_stamp":"2023-11-19T00:41:07.122048+0000","last_clean_scrub_stamp":"2023-11-19T00:41:07.122048+0000","objects_scrubbed":53,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:35:15.227402+0000","scrub_duration":0.037815080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125678,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":239950,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:55.379498+0000","last_change":"2023-11-19T00:41:55.379498+0000","last_active":"2023-11-19T00:41:55.379498+0000","last_peered":"2023-11-19T00:41:55.379498+0000","last_clean":"2023-11-19T00:41:55.379498+0000","last_became_active":"2023-11-19T00:38:39.744166+0000","last_became_peered":"2023-11-19T00:38:39.744166+0000","last_unstale":"2023-11-19T00:41:55.379498+0000","last_undegraded":"2023-11-19T00:41:55.379498+0000","last_fullsized":"2023-11-19T00:41:55.379498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:55.379368+0000","last_clean_scrub_stamp":"2023-11-19T00:41:55.379368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:40:42.997475+0000","scrub_duration":0.0022750370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"75'60","reported_seq":143,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.966258+0000","last_change":"2023-11-19T00:41:35.966258+0000","last_active":"2023-11-19T00:41:35.966258+0000","last_peered":"2023-11-19T00:41:35.966258+0000","last_clean":"2023-11-19T00:41:35.966258+0000","last_became_active":"2023-11-19T00:40:25.678357+0000","last_became_peered":"2023-11-19T00:40:25.678357+0000","last_unstale":"2023-11-19T00:41:35.966258+0000","last_undegraded":"2023-11-19T00:41:35.966258+0000","last_fullsized":"2023-11-19T00:41:35.966258+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2023-11-19T00:41:35.966137+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.966137+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:39.525924+0000","scrub_duration":0.010289223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'221","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:43:03.354740+0000","last_change":"2023-11-19T00:43:03.354740+0000","last_active":"2023-11-19T00:43:03.354740+0000","last_peered":"2023-11-19T00:43:03.354740+0000","last_clean":"2023-11-19T00:43:03.354740+0000","last_became_active":"2023-11-19T00:40:50.631031+0000","last_became_peered":"2023-11-19T00:40:50.631031+0000","last_unstale":"2023-11-19T00:43:03.354740+0000","last_undegraded":"2023-11-19T00:43:03.354740+0000","last_fullsized":"2023-11-19T00:43:03.354740+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'221","last_scrub_stamp":"2023-11-19T00:43:03.354643+0000","last_deep_scrub":"75'221","last_deep_scrub_stamp":"2023-11-19T00:43:03.354643+0000","last_clean_scrub_stamp":"2023-11-19T00:43:03.354643+0000","objects_scrubbed":61,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:38:31.995250+0000","scrub_duration":0.038250962999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":166646,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:44.289875+0000","last_change":"2023-11-19T00:42:44.289875+0000","last_active":"2023-11-19T00:42:44.289875+0000","last_peered":"2023-11-19T00:42:44.289875+0000","last_clean":"2023-11-19T00:42:44.289875+0000","last_became_active":"2023-11-19T00:40:49.647886+0000","last_became_peered":"2023-11-19T00:40:49.647886+0000","last_unstale":"2023-11-19T00:42:44.289875+0000","last_undegraded":"2023-11-19T00:42:44.289875+0000","last_fullsized":"2023-11-19T00:42:44.289875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:44.289774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:44.289774+0000","last_clean_scrub_stamp":"2023-11-19T00:42:44.289774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:23:11.415326+0000","scrub_duration":0.0015282570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:32.180679+0000","last_change":"2023-11-19T00:42:32.180679+0000","last_active":"2023-11-19T00:42:32.180679+0000","last_peered":"2023-11-19T00:42:32.180679+0000","last_clean":"2023-11-19T00:42:32.180679+0000","last_became_active":"2023-11-19T00:40:49.647934+0000","last_became_peered":"2023-11-19T00:40:49.647934+0000","last_unstale":"2023-11-19T00:42:32.180679+0000","last_undegraded":"2023-11-19T00:42:32.180679+0000","last_fullsized":"2023-11-19T00:42:32.180679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:42:32.180559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:42:32.180559+0000","last_clean_scrub_stamp":"2023-11-19T00:42:32.180559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:23:03.912458+0000","scrub_duration":0.0023940770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"75'212","reported_seq":521,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:56.316093+0000","last_change":"2023-11-19T00:42:56.316143+0000","last_active":"2023-11-19T00:42:56.316093+0000","last_peered":"2023-11-19T00:42:56.316093+0000","last_clean":"2023-11-19T00:42:56.316093+0000","last_became_active":"2023-11-19T00:40:48.630826+0000","last_became_peered":"2023-11-19T00:40:48.630826+0000","last_unstale":"2023-11-19T00:42:56.316093+0000","last_undegraded":"2023-11-19T00:42:56.316093+0000","last_fullsized":"2023-11-19T00:42:56.316093+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'212","last_scrub_stamp":"2023-11-19T00:42:56.315999+0000","last_deep_scrub":"75'212","last_deep_scrub_stamp":"2023-11-19T00:42:56.315999+0000","last_clean_scrub_stamp":"2023-11-19T00:42:56.315999+0000","objects_scrubbed":54,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:46:49.715715+0000","scrub_duration":0.037143185000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231356,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":303,"num_bytes_recovered":694068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:13.930804+0000","last_change":"2023-11-19T00:41:13.930804+0000","last_active":"2023-11-19T00:41:13.930804+0000","last_peered":"2023-11-19T00:41:13.930804+0000","last_clean":"2023-11-19T00:41:13.930804+0000","last_became_active":"2023-11-19T00:40:49.643706+0000","last_became_peered":"2023-11-19T00:40:49.643706+0000","last_unstale":"2023-11-19T00:41:13.930804+0000","last_undegraded":"2023-11-19T00:41:13.930804+0000","last_fullsized":"2023-11-19T00:41:13.930804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:13.930701+0000","last_clean_scrub_stamp":"2023-11-19T00:41:13.930701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:52.200874+0000","scrub_duration":0.001907448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:03.394178+0000","last_change":"2023-11-19T00:41:03.394178+0000","last_active":"2023-11-19T00:41:03.394178+0000","last_peered":"2023-11-19T00:41:03.394178+0000","last_clean":"2023-11-19T00:41:03.394178+0000","last_became_active":"2023-11-19T00:40:31.656204+0000","last_became_peered":"2023-11-19T00:40:31.656204+0000","last_unstale":"2023-11-19T00:41:03.394178+0000","last_undegraded":"2023-11-19T00:41:03.394178+0000","last_fullsized":"2023-11-19T00:41:03.394178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:03.394072+0000","last_clean_scrub_stamp":"2023-11-19T00:41:03.394072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:55:33.909806+0000","scrub_duration":0.0022610909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"75'200","reported_seq":301,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:39.901680+0000","last_change":"2023-11-19T00:42:39.901680+0000","last_active":"2023-11-19T00:42:39.901680+0000","last_peered":"2023-11-19T00:42:39.901680+0000","last_clean":"2023-11-19T00:42:39.901680+0000","last_became_active":"2023-11-19T00:40:49.638168+0000","last_became_peered":"2023-11-19T00:40:49.638168+0000","last_unstale":"2023-11-19T00:42:39.901680+0000","last_undegraded":"2023-11-19T00:42:39.901680+0000","last_fullsized":"2023-11-19T00:42:39.901680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:39.901536+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:39.901536+0000","last_clean_scrub_stamp":"2023-11-19T00:42:39.901536+0000","objects_scrubbed":49,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:20:21.315367+0000","scrub_duration":0.032113575999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101900,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":101900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:02.407245+0000","last_change":"2023-11-19T00:41:02.407245+0000","last_active":"2023-11-19T00:41:02.407245+0000","last_peered":"2023-11-19T00:41:02.407245+0000","last_clean":"2023-11-19T00:41:02.407245+0000","last_became_active":"2023-11-19T00:40:44.706207+0000","last_became_peered":"2023-11-19T00:40:44.706207+0000","last_unstale":"2023-11-19T00:41:02.407245+0000","last_undegraded":"2023-11-19T00:41:02.407245+0000","last_fullsized":"2023-11-19T00:41:02.407245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:02.407143+0000","last_clean_scrub_stamp":"2023-11-19T00:41:02.407143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:08:56.907868+0000","scrub_duration":0.001710039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:50.946932+0000","last_change":"2023-11-19T00:41:50.946932+0000","last_active":"2023-11-19T00:41:50.946932+0000","last_peered":"2023-11-19T00:41:50.946932+0000","last_clean":"2023-11-19T00:41:50.946932+0000","last_became_active":"2023-11-19T00:40:47.643505+0000","last_became_peered":"2023-11-19T00:40:47.643505+0000","last_unstale":"2023-11-19T00:41:50.946932+0000","last_undegraded":"2023-11-19T00:41:50.946932+0000","last_fullsized":"2023-11-19T00:41:50.946932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:50.946825+0000","last_clean_scrub_stamp":"2023-11-19T00:41:50.946825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:53:57.831781+0000","scrub_duration":0.001540832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"75'222","reported_seq":305,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:17.964280+0000","last_change":"2023-11-19T00:42:17.964280+0000","last_active":"2023-11-19T00:42:17.964280+0000","last_peered":"2023-11-19T00:42:17.964280+0000","last_clean":"2023-11-19T00:42:17.964280+0000","last_became_active":"2023-11-19T00:40:25.679845+0000","last_became_peered":"2023-11-19T00:40:25.679845+0000","last_unstale":"2023-11-19T00:42:17.964280+0000","last_undegraded":"2023-11-19T00:42:17.964280+0000","last_fullsized":"2023-11-19T00:42:17.964280+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'222","last_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_deep_scrub":"75'222","last_deep_scrub_stamp":"2023-11-19T00:42:17.964152+0000","last_clean_scrub_stamp":"2023-11-19T00:42:17.964152+0000","objects_scrubbed":45,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T10:59:56.501645+0000","scrub_duration":0.030415533000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"75'3","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:01.281847+0000","last_change":"2023-11-19T00:42:01.281847+0000","last_active":"2023-11-19T00:42:01.281847+0000","last_peered":"2023-11-19T00:42:01.281847+0000","last_clean":"2023-11-19T00:42:01.281847+0000","last_became_active":"2023-11-19T00:38:43.773086+0000","last_became_peered":"2023-11-19T00:38:43.773086+0000","last_unstale":"2023-11-19T00:42:01.281847+0000","last_undegraded":"2023-11-19T00:42:01.281847+0000","last_fullsized":"2023-11-19T00:42:01.281847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:01.281689+0000","last_clean_scrub_stamp":"2023-11-19T00:42:01.281689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:15:43.656669+0000","scrub_duration":0.003362435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:33.306598+0000","last_change":"2023-11-19T00:41:33.306598+0000","last_active":"2023-11-19T00:41:33.306598+0000","last_peered":"2023-11-19T00:41:33.306598+0000","last_clean":"2023-11-19T00:41:33.306598+0000","last_became_active":"2023-11-19T00:40:44.706448+0000","last_became_peered":"2023-11-19T00:40:44.706448+0000","last_unstale":"2023-11-19T00:41:33.306598+0000","last_undegraded":"2023-11-19T00:41:33.306598+0000","last_fullsized":"2023-11-19T00:41:33.306598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:33.306492+0000","last_clean_scrub_stamp":"2023-11-19T00:41:33.306492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:54:35.500265+0000","scrub_duration":0.0019877990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"75'227","reported_seq":292,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:44.248346+0000","last_change":"2023-11-19T00:42:44.248346+0000","last_active":"2023-11-19T00:42:44.248346+0000","last_peered":"2023-11-19T00:42:44.248346+0000","last_clean":"2023-11-19T00:42:44.248346+0000","last_became_active":"2023-11-19T00:40:48.637349+0000","last_became_peered":"2023-11-19T00:40:48.637349+0000","last_unstale":"2023-11-19T00:42:44.248346+0000","last_undegraded":"2023-11-19T00:42:44.248346+0000","last_fullsized":"2023-11-19T00:42:44.248346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'227","last_scrub_stamp":"2023-11-19T00:42:44.248229+0000","last_deep_scrub":"75'227","last_deep_scrub_stamp":"2023-11-19T00:42:44.248229+0000","last_clean_scrub_stamp":"2023-11-19T00:42:44.248229+0000","objects_scrubbed":57,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:38:16.253840+0000","scrub_duration":0.040383757999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":299817,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":283433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"75'13","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:39.359724+0000","last_change":"2023-11-19T00:41:39.359724+0000","last_active":"2023-11-19T00:41:39.359724+0000","last_peered":"2023-11-19T00:41:39.359724+0000","last_clean":"2023-11-19T00:41:39.359724+0000","last_became_active":"2023-11-19T00:40:44.708457+0000","last_became_peered":"2023-11-19T00:40:44.708457+0000","last_unstale":"2023-11-19T00:41:39.359724+0000","last_undegraded":"2023-11-19T00:41:39.359724+0000","last_fullsized":"2023-11-19T00:41:39.359724+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'13","last_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_deep_scrub":"75'13","last_deep_scrub_stamp":"2023-11-19T00:41:39.359569+0000","last_clean_scrub_stamp":"2023-11-19T00:41:39.359569+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:16:28.035657+0000","scrub_duration":0.0044493909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":99,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:18.983296+0000","last_change":"2023-11-19T00:41:18.983296+0000","last_active":"2023-11-19T00:41:18.983296+0000","last_peered":"2023-11-19T00:41:18.983296+0000","last_clean":"2023-11-19T00:41:18.983296+0000","last_became_active":"2023-11-19T00:40:49.635538+0000","last_became_peered":"2023-11-19T00:40:49.635538+0000","last_unstale":"2023-11-19T00:41:18.983296+0000","last_undegraded":"2023-11-19T00:41:18.983296+0000","last_fullsized":"2023-11-19T00:41:18.983296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:18.983139+0000","last_clean_scrub_stamp":"2023-11-19T00:41:18.983139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:15:41.254459+0000","scrub_duration":0.002267593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"75'186","reported_seq":285,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:32.952330+0000","last_change":"2023-11-19T00:41:32.952330+0000","last_active":"2023-11-19T00:41:32.952330+0000","last_peered":"2023-11-19T00:41:32.952330+0000","last_clean":"2023-11-19T00:41:32.952330+0000","last_became_active":"2023-11-19T00:40:36.674042+0000","last_became_peered":"2023-11-19T00:40:36.674042+0000","last_unstale":"2023-11-19T00:41:32.952330+0000","last_undegraded":"2023-11-19T00:41:32.952330+0000","last_fullsized":"2023-11-19T00:41:32.952330+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'186","last_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_deep_scrub":"75'186","last_deep_scrub_stamp":"2023-11-19T00:41:32.952223+0000","last_clean_scrub_stamp":"2023-11-19T00:41:32.952223+0000","objects_scrubbed":51,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:39:14.957145+0000","scrub_duration":0.037260673000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358488,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":358488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"75'218","reported_seq":519,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:25.289015+0000","last_change":"2023-11-19T00:42:25.289056+0000","last_active":"2023-11-19T00:42:25.289015+0000","last_peered":"2023-11-19T00:42:25.289015+0000","last_clean":"2023-11-19T00:42:25.289015+0000","last_became_active":"2023-11-19T00:40:49.635308+0000","last_became_peered":"2023-11-19T00:40:49.635308+0000","last_unstale":"2023-11-19T00:42:25.289015+0000","last_undegraded":"2023-11-19T00:42:25.289015+0000","last_fullsized":"2023-11-19T00:42:25.289015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'218","last_scrub_stamp":"2023-11-19T00:42:25.288919+0000","last_deep_scrub":"75'218","last_deep_scrub_stamp":"2023-11-19T00:42:25.288919+0000","last_clean_scrub_stamp":"2023-11-19T00:42:25.288919+0000","objects_scrubbed":50,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:12.971024+0000","scrub_duration":0.040409217999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170155,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":153143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"75'46","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:34.879339+0000","last_change":"2023-11-19T00:41:34.879370+0000","last_active":"2023-11-19T00:41:34.879339+0000","last_peered":"2023-11-19T00:41:34.879339+0000","last_clean":"2023-11-19T00:41:34.879339+0000","last_became_active":"2023-11-19T00:40:49.636037+0000","last_became_peered":"2023-11-19T00:40:49.636037+0000","last_unstale":"2023-11-19T00:41:34.879339+0000","last_undegraded":"2023-11-19T00:41:34.879339+0000","last_fullsized":"2023-11-19T00:41:34.879339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2023-11-19T00:41:34.879255+0000","last_clean_scrub_stamp":"2023-11-19T00:41:34.879255+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:48:29.054637+0000","scrub_duration":0.011582451000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"75'200","reported_seq":684,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:36.272713+0000","last_change":"2023-11-19T00:42:36.272763+0000","last_active":"2023-11-19T00:42:36.272713+0000","last_peered":"2023-11-19T00:42:36.272713+0000","last_clean":"2023-11-19T00:42:36.272713+0000","last_became_active":"2023-11-19T00:40:49.644767+0000","last_became_peered":"2023-11-19T00:40:49.644767+0000","last_unstale":"2023-11-19T00:42:36.272713+0000","last_undegraded":"2023-11-19T00:42:36.272713+0000","last_fullsized":"2023-11-19T00:42:36.272713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'200","last_scrub_stamp":"2023-11-19T00:42:36.272626+0000","last_deep_scrub":"75'200","last_deep_scrub_stamp":"2023-11-19T00:42:36.272626+0000","last_clean_scrub_stamp":"2023-11-19T00:42:36.272626+0000","objects_scrubbed":46,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:19:23.954732+0000","scrub_duration":0.031714834999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271002,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":521074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"75'21","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:35.005876+0000","last_change":"2023-11-19T00:41:35.005876+0000","last_active":"2023-11-19T00:41:35.005876+0000","last_peered":"2023-11-19T00:41:35.005876+0000","last_clean":"2023-11-19T00:41:35.005876+0000","last_became_active":"2023-11-19T00:40:46.714428+0000","last_became_peered":"2023-11-19T00:40:46.714428+0000","last_unstale":"2023-11-19T00:41:35.005876+0000","last_undegraded":"2023-11-19T00:41:35.005876+0000","last_fullsized":"2023-11-19T00:41:35.005876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'21","last_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_deep_scrub":"75'21","last_deep_scrub_stamp":"2023-11-19T00:41:35.005745+0000","last_clean_scrub_stamp":"2023-11-19T00:41:35.005745+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:31:58.190130+0000","scrub_duration":0.0037074590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:49.033609+0000","last_change":"2023-11-19T00:41:49.033646+0000","last_active":"2023-11-19T00:41:49.033609+0000","last_peered":"2023-11-19T00:41:49.033609+0000","last_clean":"2023-11-19T00:41:49.033609+0000","last_became_active":"2023-11-19T00:40:49.646049+0000","last_became_peered":"2023-11-19T00:40:49.646049+0000","last_unstale":"2023-11-19T00:41:49.033609+0000","last_undegraded":"2023-11-19T00:41:49.033609+0000","last_fullsized":"2023-11-19T00:41:49.033609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:49.033509+0000","last_clean_scrub_stamp":"2023-11-19T00:41:49.033509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:25:09.818062+0000","scrub_duration":0.0016660780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"75'231","reported_seq":310,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:22.189106+0000","last_change":"2023-11-19T00:42:22.189147+0000","last_active":"2023-11-19T00:42:22.189106+0000","last_peered":"2023-11-19T00:42:22.189106+0000","last_clean":"2023-11-19T00:42:22.189106+0000","last_became_active":"2023-11-19T00:38:44.772987+0000","last_became_peered":"2023-11-19T00:38:44.772987+0000","last_unstale":"2023-11-19T00:42:22.189106+0000","last_undegraded":"2023-11-19T00:42:22.189106+0000","last_fullsized":"2023-11-19T00:42:22.189106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'231","last_scrub_stamp":"2023-11-19T00:42:22.189028+0000","last_deep_scrub":"75'231","last_deep_scrub_stamp":"2023-11-19T00:42:22.189028+0000","last_clean_scrub_stamp":"2023-11-19T00:42:22.189028+0000","objects_scrubbed":61,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:28:01.634373+0000","scrub_duration":0.042413226999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116656,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"39'1","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:07.247582+0000","last_change":"2023-11-19T00:42:07.247621+0000","last_active":"2023-11-19T00:42:07.247582+0000","last_peered":"2023-11-19T00:42:07.247582+0000","last_clean":"2023-11-19T00:42:07.247582+0000","last_became_active":"2023-11-19T00:38:43.775312+0000","last_became_peered":"2023-11-19T00:38:43.775312+0000","last_unstale":"2023-11-19T00:42:07.247582+0000","last_undegraded":"2023-11-19T00:42:07.247582+0000","last_fullsized":"2023-11-19T00:42:07.247582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1","last_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_deep_scrub":"39'1","last_deep_scrub_stamp":"2023-11-19T00:42:07.247482+0000","last_clean_scrub_stamp":"2023-11-19T00:42:07.247482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:43.797824+0000","scrub_duration":0.0013240540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"75'209","reported_seq":508,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:47.308659+0000","last_change":"2023-11-19T00:42:47.308659+0000","last_active":"2023-11-19T00:42:47.308659+0000","last_peered":"2023-11-19T00:42:47.308659+0000","last_clean":"2023-11-19T00:42:47.308659+0000","last_became_active":"2023-11-19T00:40:48.630367+0000","last_became_peered":"2023-11-19T00:40:48.630367+0000","last_unstale":"2023-11-19T00:42:47.308659+0000","last_undegraded":"2023-11-19T00:42:47.308659+0000","last_fullsized":"2023-11-19T00:42:47.308659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'209","last_scrub_stamp":"2023-11-19T00:42:47.308479+0000","last_deep_scrub":"75'209","last_deep_scrub_stamp":"2023-11-19T00:42:47.308479+0000","last_clean_scrub_stamp":"2023-11-19T00:42:47.308479+0000","objects_scrubbed":54,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:53:21.586844+0000","scrub_duration":0.037357785999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96021,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":288063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'219","reported_seq":308,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.954366+0000","last_change":"2023-11-19T00:42:02.954366+0000","last_active":"2023-11-19T00:42:02.954366+0000","last_peered":"2023-11-19T00:42:02.954366+0000","last_clean":"2023-11-19T00:42:02.954366+0000","last_became_active":"2023-11-19T00:40:25.677094+0000","last_became_peered":"2023-11-19T00:40:25.677094+0000","last_unstale":"2023-11-19T00:42:02.954366+0000","last_undegraded":"2023-11-19T00:42:02.954366+0000","last_fullsized":"2023-11-19T00:42:02.954366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'219","last_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_deep_scrub":"75'219","last_deep_scrub_stamp":"2023-11-19T00:42:02.954261+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.954261+0000","objects_scrubbed":56,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:31:04.790371+0000","scrub_duration":0.040234886999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143502,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"45'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:44.366153+0000","last_change":"2023-11-19T00:41:44.366204+0000","last_active":"2023-11-19T00:41:44.366153+0000","last_peered":"2023-11-19T00:41:44.366153+0000","last_clean":"2023-11-19T00:41:44.366153+0000","last_became_active":"2023-11-19T00:40:46.713607+0000","last_became_peered":"2023-11-19T00:40:46.713607+0000","last_unstale":"2023-11-19T00:41:44.366153+0000","last_undegraded":"2023-11-19T00:41:44.366153+0000","last_fullsized":"2023-11-19T00:41:44.366153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'1","last_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_deep_scrub":"45'1","last_deep_scrub_stamp":"2023-11-19T00:41:44.366059+0000","last_clean_scrub_stamp":"2023-11-19T00:41:44.366059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:07:42.639601+0000","scrub_duration":0.001898725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"75'202","reported_seq":281,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:19.306669+0000","last_change":"2023-11-19T00:41:19.306669+0000","last_active":"2023-11-19T00:41:19.306669+0000","last_peered":"2023-11-19T00:41:19.306669+0000","last_clean":"2023-11-19T00:41:19.306669+0000","last_became_active":"2023-11-19T00:38:44.777149+0000","last_became_peered":"2023-11-19T00:38:44.777149+0000","last_unstale":"2023-11-19T00:41:19.306669+0000","last_undegraded":"2023-11-19T00:41:19.306669+0000","last_fullsized":"2023-11-19T00:41:19.306669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'202","last_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_deep_scrub":"75'202","last_deep_scrub_stamp":"2023-11-19T00:41:19.306536+0000","last_clean_scrub_stamp":"2023-11-19T00:41:19.306536+0000","objects_scrubbed":49,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:17.124610+0000","scrub_duration":0.034907383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182431,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:06.281350+0000","last_change":"2023-11-19T00:41:06.281350+0000","last_active":"2023-11-19T00:41:06.281350+0000","last_peered":"2023-11-19T00:41:06.281350+0000","last_clean":"2023-11-19T00:41:06.281350+0000","last_became_active":"2023-11-19T00:40:44.704156+0000","last_became_peered":"2023-11-19T00:40:44.704156+0000","last_unstale":"2023-11-19T00:41:06.281350+0000","last_undegraded":"2023-11-19T00:41:06.281350+0000","last_fullsized":"2023-11-19T00:41:06.281350+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-19T00:41:06.281244+0000","last_clean_scrub_stamp":"2023-11-19T00:41:06.281244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:29:23.140955+0000","scrub_duration":0.0017497389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"75'211","reported_seq":297,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:27.901382+0000","last_change":"2023-11-19T00:42:27.901444+0000","last_active":"2023-11-19T00:42:27.901382+0000","last_peered":"2023-11-19T00:42:27.901382+0000","last_clean":"2023-11-19T00:42:27.901382+0000","last_became_active":"2023-11-19T00:40:25.676792+0000","last_became_peered":"2023-11-19T00:40:25.676792+0000","last_unstale":"2023-11-19T00:42:27.901382+0000","last_undegraded":"2023-11-19T00:42:27.901382+0000","last_fullsized":"2023-11-19T00:42:27.901382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'211","last_scrub_stamp":"2023-11-19T00:42:27.901274+0000","last_deep_scrub":"75'211","last_deep_scrub_stamp":"2023-11-19T00:42:27.901274+0000","last_clean_scrub_stamp":"2023-11-19T00:42:27.901274+0000","objects_scrubbed":48,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:14.699783+0000","scrub_duration":0.037691249000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107180,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"75'6","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:34.899826+0000","last_change":"2023-11-19T00:42:34.899885+0000","last_active":"2023-11-19T00:42:34.899826+0000","last_peered":"2023-11-19T00:42:34.899826+0000","last_clean":"2023-11-19T00:42:34.899826+0000","last_became_active":"2023-11-19T00:40:47.642743+0000","last_became_peered":"2023-11-19T00:40:47.642743+0000","last_unstale":"2023-11-19T00:42:34.899826+0000","last_undegraded":"2023-11-19T00:42:34.899826+0000","last_fullsized":"2023-11-19T00:42:34.899826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2023-11-19T00:42:34.899734+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2023-11-19T00:42:34.899734+0000","last_clean_scrub_stamp":"2023-11-19T00:42:34.899734+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:39:28.534968+0000","scrub_duration":0.0089668409999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"75'220","reported_seq":752,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:15.986982+0000","last_change":"2023-11-19T00:41:15.986982+0000","last_active":"2023-11-19T00:41:15.986982+0000","last_peered":"2023-11-19T00:41:15.986982+0000","last_clean":"2023-11-19T00:41:15.986982+0000","last_became_active":"2023-11-19T00:40:49.646359+0000","last_became_peered":"2023-11-19T00:40:49.646359+0000","last_unstale":"2023-11-19T00:41:15.986982+0000","last_undegraded":"2023-11-19T00:41:15.986982+0000","last_fullsized":"2023-11-19T00:41:15.986982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'220","last_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_deep_scrub":"75'220","last_deep_scrub_stamp":"2023-11-19T00:41:15.986886+0000","last_clean_scrub_stamp":"2023-11-19T00:41:15.986886+0000","objects_scrubbed":53,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:34:40.565603+0000","scrub_duration":0.036034849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96253,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":192506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"75'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:29.949973+0000","last_change":"2023-11-19T00:41:29.949973+0000","last_active":"2023-11-19T00:41:29.949973+0000","last_peered":"2023-11-19T00:41:29.949973+0000","last_clean":"2023-11-19T00:41:29.949973+0000","last_became_active":"2023-11-19T00:40:46.713225+0000","last_became_peered":"2023-11-19T00:40:46.713225+0000","last_unstale":"2023-11-19T00:41:29.949973+0000","last_undegraded":"2023-11-19T00:41:29.949973+0000","last_fullsized":"2023-11-19T00:41:29.949973+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'7","last_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_deep_scrub":"75'7","last_deep_scrub_stamp":"2023-11-19T00:41:29.949858+0000","last_clean_scrub_stamp":"2023-11-19T00:41:29.949858+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:16:37.535582+0000","scrub_duration":0.009494878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"75'207","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:02.229246+0000","last_change":"2023-11-19T00:42:02.229284+0000","last_active":"2023-11-19T00:42:02.229246+0000","last_peered":"2023-11-19T00:42:02.229246+0000","last_clean":"2023-11-19T00:42:02.229246+0000","last_became_active":"2023-11-19T00:40:49.647015+0000","last_became_peered":"2023-11-19T00:40:49.647015+0000","last_unstale":"2023-11-19T00:42:02.229246+0000","last_undegraded":"2023-11-19T00:42:02.229246+0000","last_fullsized":"2023-11-19T00:42:02.229246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'207","last_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_deep_scrub":"75'207","last_deep_scrub_stamp":"2023-11-19T00:42:02.229170+0000","last_clean_scrub_stamp":"2023-11-19T00:42:02.229170+0000","objects_scrubbed":66,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:22:38.779512+0000","scrub_duration":0.044979045000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"75'3","reported_seq":90,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:31.202683+0000","last_change":"2023-11-19T00:42:31.202710+0000","last_active":"2023-11-19T00:42:31.202683+0000","last_peered":"2023-11-19T00:42:31.202683+0000","last_clean":"2023-11-19T00:42:31.202683+0000","last_became_active":"2023-11-19T00:40:49.648620+0000","last_became_peered":"2023-11-19T00:40:49.648620+0000","last_unstale":"2023-11-19T00:42:31.202683+0000","last_undegraded":"2023-11-19T00:42:31.202683+0000","last_fullsized":"2023-11-19T00:42:31.202683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:31.202607+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:31.202607+0000","last_clean_scrub_stamp":"2023-11-19T00:42:31.202607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T11:30:59.375894+0000","scrub_duration":0.003221341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"75'213","reported_seq":276,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:42.308706+0000","last_change":"2023-11-19T00:42:42.308732+0000","last_active":"2023-11-19T00:42:42.308706+0000","last_peered":"2023-11-19T00:42:42.308706+0000","last_clean":"2023-11-19T00:42:42.308706+0000","last_became_active":"2023-11-19T00:40:49.648345+0000","last_became_peered":"2023-11-19T00:40:49.648345+0000","last_unstale":"2023-11-19T00:42:42.308706+0000","last_undegraded":"2023-11-19T00:42:42.308706+0000","last_fullsized":"2023-11-19T00:42:42.308706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'213","last_scrub_stamp":"2023-11-19T00:42:42.308635+0000","last_deep_scrub":"75'213","last_deep_scrub_stamp":"2023-11-19T00:42:42.308635+0000","last_clean_scrub_stamp":"2023-11-19T00:42:42.308635+0000","objects_scrubbed":52,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:07:33.586799+0000","scrub_duration":0.035823174999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192850,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"75'56","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:48.925143+0000","last_change":"2023-11-19T00:41:48.925171+0000","last_active":"2023-11-19T00:41:48.925143+0000","last_peered":"2023-11-19T00:41:48.925143+0000","last_clean":"2023-11-19T00:41:48.925143+0000","last_became_active":"2023-11-19T00:40:25.676825+0000","last_became_peered":"2023-11-19T00:40:25.676825+0000","last_unstale":"2023-11-19T00:41:48.925143+0000","last_undegraded":"2023-11-19T00:41:48.925143+0000","last_fullsized":"2023-11-19T00:41:48.925143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'56","last_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_deep_scrub":"75'56","last_deep_scrub_stamp":"2023-11-19T00:41:48.925067+0000","last_clean_scrub_stamp":"2023-11-19T00:41:48.925067+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:26:37.416531+0000","scrub_duration":0.016421860999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"75'228","reported_seq":544,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:04.083863+0000","last_change":"2023-11-19T00:41:04.083863+0000","last_active":"2023-11-19T00:41:04.083863+0000","last_peered":"2023-11-19T00:41:04.083863+0000","last_clean":"2023-11-19T00:41:04.083863+0000","last_became_active":"2023-11-19T00:40:47.641252+0000","last_became_peered":"2023-11-19T00:40:47.641252+0000","last_unstale":"2023-11-19T00:41:04.083863+0000","last_undegraded":"2023-11-19T00:41:04.083863+0000","last_fullsized":"2023-11-19T00:41:04.083863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'228","last_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_deep_scrub":"75'228","last_deep_scrub_stamp":"2023-11-19T00:41:04.083754+0000","last_clean_scrub_stamp":"2023-11-19T00:41:04.083754+0000","objects_scrubbed":57,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T09:04:56.786572+0000","scrub_duration":0.039326976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107088,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":107088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"75'3","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:42:13.242967+0000","last_change":"2023-11-19T00:42:13.242967+0000","last_active":"2023-11-19T00:42:13.242967+0000","last_peered":"2023-11-19T00:42:13.242967+0000","last_clean":"2023-11-19T00:42:13.242967+0000","last_became_active":"2023-11-19T00:38:43.776471+0000","last_became_peered":"2023-11-19T00:38:43.776471+0000","last_unstale":"2023-11-19T00:42:13.242967+0000","last_undegraded":"2023-11-19T00:42:13.242967+0000","last_fullsized":"2023-11-19T00:42:13.242967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'3","last_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_deep_scrub":"75'3","last_deep_scrub_stamp":"2023-11-19T00:42:13.242851+0000","last_clean_scrub_stamp":"2023-11-19T00:42:13.242851+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T08:00:19.880790+0000","scrub_duration":0.0092839810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"75'254","reported_seq":579,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:45.012072+0000","last_change":"2023-11-19T00:41:45.012108+0000","last_active":"2023-11-19T00:41:45.012072+0000","last_peered":"2023-11-19T00:41:45.012072+0000","last_clean":"2023-11-19T00:41:45.012072+0000","last_became_active":"2023-11-19T00:40:49.643502+0000","last_became_peered":"2023-11-19T00:40:49.643502+0000","last_unstale":"2023-11-19T00:41:45.012072+0000","last_undegraded":"2023-11-19T00:41:45.012072+0000","last_fullsized":"2023-11-19T00:41:45.012072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'254","last_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_deep_scrub":"75'254","last_deep_scrub_stamp":"2023-11-19T00:41:45.011994+0000","last_clean_scrub_stamp":"2023-11-19T00:41:45.011994+0000","objects_scrubbed":64,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:55:03.705015+0000","scrub_duration":0.043843721000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175118,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":175118,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"75'18","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-19T00:41:11.205737+0000","last_change":"2023-11-19T00:41:11.205737+0000","last_active":"2023-11-19T00:41:11.205737+0000","last_peered":"2023-11-19T00:41:11.205737+0000","last_clean":"2023-11-19T00:41:11.205737+0000","last_became_active":"2023-11-19T00:40:44.705031+0000","last_became_peered":"2023-11-19T00:40:44.705031+0000","last_unstale":"2023-11-19T00:41:11.205737+0000","last_undegraded":"2023-11-19T00:41:11.205737+0000","last_fullsized":"2023-11-19T00:41:11.205737+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'18","last_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_deep_scrub":"75'18","last_deep_scrub_stamp":"2023-11-19T00:41:11.205579+0000","last_clean_scrub_stamp":"2023-11-19T00:41:11.205579+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T12:35:37.711995+0000","scrub_duration":0.010464658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26212368,"num_objects":3446,"num_object_clones":0,"num_object_copies":6892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10392,"num_write_kb":38410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5384,"num_bytes_recovered":28461256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72130560,"data_stored":52103048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13677,"ondisk_log_size":13677,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41050048,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":33,"num_read_kb":333,"num_write":430,"num_write_kb":40614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":12583696,"num_keys_recovered":99,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82157568,"data_stored":82100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":464,"ondisk_log_size":464,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90672,"kb_used_data":45608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94281168,"statfs":{"total":96636764160,"available":96543916032,"internally_reserved":0,"allocated":46702592,"data_stored":39132607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 19 00:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.33100000000000002,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.50900000000000001}]},{"osd":2,"last update":"Sun Nov 19 00:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.29799999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.45700000000000002},"min":{"1min":0.32100000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.46700000000000003}]}]},{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110068,"kb_used_data":52524,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94261772,"statfs":{"total":96636764160,"available":96524054528,"internally_reserved":0,"allocated":53784576,"data_stored":46884726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.253,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.68400000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.63},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.47399999999999998},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65900000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Nov 19 00:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45400000000000001,"15min":0.46999999999999997},"min":{"1min":0.32000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.46600000000000003},"min":{"1min":0.34200000000000003,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.622,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.59899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104964,"kb_used_data":55740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94266876,"statfs":{"total":96636764160,"available":96529281024,"internally_reserved":0,"allocated":57077760,"data_stored":50294183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 19 00:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.437,"15min":0.45600000000000002},"min":{"1min":0.23300000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.55900000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.27100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58699999999999997,"5min":0.625,"15min":0.625},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Nov 19 00:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.436,"15min":0.44700000000000001},"min":{"1min":0.32500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.439,"15min":0.443},"min":{"1min":0.29099999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20086784,"data_stored":20077674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32690176,"data_stored":32661440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25919488,"data_stored":18745721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26406912,"data_stored":20033621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19804160,"data_stored":13323706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-19T00:43:24.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-19T00:43:24.547 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-19T00:43:24.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-19T00:43:24.880 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:43:24.880 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-19T00:38:44.121737+0000","modified":"2023-11-19T00:38:46.120615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/3311622644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3311622644},{"type":"v1","addr":"172.21.15.46:6803","nonce":3311622644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-19T00:43:24.880 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2023-11-19T00:43:24.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-19T00:43:25.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:43:25.226 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-19T00:38:44.121737+0000","modified":"2023-11-19T00:38:46.120615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/3311622644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3311622644},{"type":"v1","addr":"172.21.15.46:6803","nonce":3311622644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-19T00:43:25.226 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2023-11-19T00:43:25.237 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-19T00:43:25.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-11-19T00:43:25.534 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":75,"fsid":"8d6e5d21-0548-4be9-97cd-ecd717c3d6dc","created":"2023-11-19T00:38:22.632723+0000","modified":"2023-11-19T00:40:50.624970+0000","last_up_change":"2023-11-19T00:38:32.614375+0000","last_in_change":"2023-11-19T00:38:23.684697+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-19T00:38:33.077694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-19T00:38:37.909259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-19T00:38:42.590087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-19T00:38:43.103062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecde3678-8154-4745-bf35-fa177f3451e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6801","nonce":1937409726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6803","nonce":1937409726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6807","nonce":1937409726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1937409726},{"type":"v1","addr":"172.21.15.73:6805","nonce":1937409726}]},"public_addr":"172.21.15.73:6801/1937409726","cluster_addr":"172.21.15.73:6803/1937409726","heartbeat_back_addr":"172.21.15.73:6807/1937409726","heartbeat_front_addr":"172.21.15.73:6805/1937409726","state":["exists","up"]},{"osd":1,"uuid":"5246e241-d0ea-4f75-9ef4-3f1b7d8ca2c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6801","nonce":2703344366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6803","nonce":2703344366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6807","nonce":2703344366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2703344366},{"type":"v1","addr":"172.21.15.99:6805","nonce":2703344366}]},"public_addr":"172.21.15.99:6801/2703344366","cluster_addr":"172.21.15.99:6803/2703344366","heartbeat_back_addr":"172.21.15.99:6807/2703344366","heartbeat_front_addr":"172.21.15.99:6805/2703344366","state":["exists","up"]},{"osd":2,"uuid":"8c9f9502-5eda-4cac-9485-b0ac8ea158dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6801","nonce":1047303295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6803","nonce":1047303295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6807","nonce":1047303295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1047303295},{"type":"v1","addr":"172.21.15.181:6805","nonce":1047303295}]},"public_addr":"172.21.15.181:6801/1047303295","cluster_addr":"172.21.15.181:6803/1047303295","heartbeat_back_addr":"172.21.15.181:6807/1047303295","heartbeat_front_addr":"172.21.15.181:6805/1047303295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.692333+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.704826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-19T00:38:28.702890+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-19T00:43:25.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-19T00:43:25.883 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-19T00:43:25.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-19T00:43:25.925 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-11-19T00:43:26.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-19T00:43:27.892 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-11-19T00:43:27.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-19T00:43:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-11-19T00:43:28.911 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-19T00:43:28.911 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-19T00:43:28.911 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:28.920 INFO:tasks.ceph.mds.a:Stopped 2023-11-19T00:43:28.921 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-19T00:43:28.921 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-19T00:43:28.921 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:28.956 INFO:tasks.ceph.osd.0:Stopped 2023-11-19T00:43:28.957 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-19T00:43:28.957 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:28.996 INFO:tasks.ceph.osd.1:Stopped 2023-11-19T00:43:28.996 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-19T00:43:28.996 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:29.041 INFO:tasks.ceph.osd.2:Stopped 2023-11-19T00:43:29.042 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-19T00:43:29.042 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-19T00:43:29.042 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:29.070 INFO:tasks.ceph.mgr.x:Stopped 2023-11-19T00:43:29.070 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-19T00:43:29.071 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:29.136 INFO:tasks.ceph.mgr.y:Stopped 2023-11-19T00:43:29.136 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-19T00:43:29.137 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-19T00:43:29.137 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:29.189 INFO:tasks.ceph.mon.a:Stopped 2023-11-19T00:43:29.189 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-19T00:43:29.189 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:29.240 INFO:tasks.ceph.mon.b:Stopped 2023-11-19T00:43:29.240 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-19T00:43:29.241 INFO:teuthology.orchestra.run:waiting for 300 2023-11-19T00:43:29.292 INFO:tasks.ceph.mon.c:Stopped 2023-11-19T00:43:29.292 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-19T00:43:29.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2023-11-19T00:43:29.370 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-19T00:43:29.370 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-19T00:43:29.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2023-11-19T00:43:29.485 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-19T00:43:29.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi181.front.sepia.ceph.com 2023-11-19T00:43:29.598 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-19T00:43:29.694 INFO:tasks.ceph:Archiving mon data... 2023-11-19T00:43:29.695 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/data/mon.a.tgz 2023-11-19T00:43:29.695 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-11-19T00:43:29.712 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.GljQE2H2zu 2023-11-19T00:43:29.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GljQE2H2zu 2023-11-19T00:43:29.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.GljQE2H2zu 2023-11-19T00:43:29.953 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.GljQE2H2zu is 343KB 2023-11-19T00:43:30.050 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.GljQE2H2zu 2023-11-19T00:43:30.065 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/data/mon.b.tgz 2023-11-19T00:43:30.065 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-11-19T00:43:30.120 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.UKPKHPIA5C 2023-11-19T00:43:30.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.UKPKHPIA5C 2023-11-19T00:43:30.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.UKPKHPIA5C 2023-11-19T00:43:30.372 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.UKPKHPIA5C is 477KB 2023-11-19T00:43:30.468 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.UKPKHPIA5C 2023-11-19T00:43:30.483 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/data/mon.c.tgz 2023-11-19T00:43:30.483 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-11-19T00:43:30.537 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.7VPdf008u9 2023-11-19T00:43:30.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7VPdf008u9 2023-11-19T00:43:30.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.7VPdf008u9 2023-11-19T00:43:30.791 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.7VPdf008u9 is 477KB 2023-11-19T00:43:30.887 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.7VPdf008u9 2023-11-19T00:43:30.902 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-19T00:43:30.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-19T00:43:30.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-19T00:43:30.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-19T00:43:30.951 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-19T00:43:30.982 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-19T00:43:30.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-19T00:43:31.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-19T00:43:31.020 DEBUG:teuthology.orchestra.run.smithi099:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-19T00:43:31.022 DEBUG:teuthology.orchestra.run.smithi181:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-19T00:43:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-19T00:43:31.051 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-19T00:43:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-19T00:43:31.056 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-19T00:43:31.060 INFO:tasks.ceph:Archiving crash dumps... 2023-11-19T00:43:31.062 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi046/crash 2023-11-19T00:43:31.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-19T00:43:31.119 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi073/crash 2023-11-19T00:43:31.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-19T00:43:31.172 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi099/crash 2023-11-19T00:43:31.173 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-19T00:43:31.217 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi181/crash 2023-11-19T00:43:31.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-19T00:43:31.422 INFO:tasks.ceph:Compressing logs... 2023-11-19T00:43:31.423 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-19T00:43:31.425 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-19T00:43:31.428 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-19T00:43:31.430 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-19T00:43:31.453 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83644.log 2023-11-19T00:43:31.461 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-19T00:43:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-19T00:43:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81361.log 2023-11-19T00:43:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81321.log 2023-11-19T00:43:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.81361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81401.log 2023-11-19T00:43:31.470 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81361.log.gz 2023-11-19T00:43:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.81321.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-19T00:43:31.471 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81321.log.gz 2023-11-19T00:43:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.81401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81401.log.gz 2023-11-19T00:43:31.529 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82747.log 2023-11-19T00:43:31.529 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97358.log 2023-11-19T00:43:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83644.log.gz 2023-11-19T00:43:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82747.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-19T00:43:31.530 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82747.log.gz 2023-11-19T00:43:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96209.log 2023-11-19T00:43:31.530 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97358.log.gz 2023-11-19T00:43:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87527.log 2023-11-19T00:43:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86806.log 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96209.log.gz 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83978.log 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87527.log.gz 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84904.log 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86806.log.gz 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95832.log 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83978.log.gz 2023-11-19T00:43:31.531 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.84904.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.84400.log 2023-11-19T00:43:31.532 INFO:teuthology.orchestra.run.smithi046.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.84904.log.gz 2023-11-19T00:43:31.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83958.log 2023-11-19T00:43:31.532 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95832.log.gz 2023-11-19T00:43:31.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86279.log 2023-11-19T00:43:31.532 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84400.log.gz 2023-11-19T00:43:31.532 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83725.log 2023-11-19T00:43:31.532 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83958.log.gz 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97064.log 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86279.log.gz 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96643.log 0.0% 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83725.log.gz 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82172.log 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97064.log.gz 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86454.log 2023-11-19T00:43:31.533 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96643.log.gz 2023-11-19T00:43:31.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82172.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.82172.log.gz --verbose 2023-11-19T00:43:31.534 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.96765.log 2023-11-19T00:43:31.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97904.log 2023-11-19T00:43:31.534 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86454.log.gz 2023-11-19T00:43:31.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99055.log 2023-11-19T00:43:31.534 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96765.log.gz 2023-11-19T00:43:31.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96938.log 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97904.log.gz 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97022.log 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99055.log.gz 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98534.log 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96938.log.gz 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85275.log 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97022.log.gz 2023-11-19T00:43:31.535 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85028.log 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98534.log.gz 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82831.log 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85275.log.gz 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84568.log 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85028.log.gz 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88171.log 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82831.log.gz 2023-11-19T00:43:31.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86631.log 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84568.log.gz 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89155.log 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88171.log.gz 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87616.log 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86631.log.gz 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.89155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86717.log 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89155.log.gz 2023-11-19T00:43:31.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84358.log 2023-11-19T00:43:31.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87616.log.gz 2023-11-19T00:43:31.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96482.log 2023-11-19T00:43:31.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86717.log.gz 2023-11-19T00:43:31.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83851.log 2023-11-19T00:43:31.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84358.log.gz 2023-11-19T00:43:31.538 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83137.log 2023-11-19T00:43:31.538 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96482.log.gz 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84232.log 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83851.log.gz 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88509.log 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83137.log.gz 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.84232.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98030.log 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84232.log.gz 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96118.log 2023-11-19T00:43:31.539 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88509.log.gz 2023-11-19T00:43:31.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98826.log 2023-11-19T00:43:31.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98030.log.gz 2023-11-19T00:43:31.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84652.log 2023-11-19T00:43:31.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96118.log.gz 2023-11-19T00:43:31.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97190.log 2023-11-19T00:43:31.540 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98826.log.gz 2023-11-19T00:43:31.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91825.log 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84652.log.gz 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83726.log 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97190.log.gz 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.91825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83850.log 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91825.log.gz 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97148.log 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83726.log.gz 2023-11-19T00:43:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85811.log 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83850.log.gz 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84190.log 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97148.log.gz 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.85811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86108.log 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr: 32.7% -- replaced with /var/log/ceph/ceph-client.0.85811.log.gz 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98868.log 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84190.log.gz 2023-11-19T00:43:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94835.log 2023-11-19T00:43:31.543 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86108.log.gz 2023-11-19T00:43:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83266.log 2023-11-19T00:43:31.543 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98868.log.gz 2023-11-19T00:43:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.94835.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.83003.log 2023-11-19T00:43:31.543 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94835.log.gz 2023-11-19T00:43:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98660.log 2023-11-19T00:43:31.543 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83266.log.gz 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83003.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.83003.log.gz /var/log/ceph/ceph-client.admin.86197.log 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84820.log 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98660.log.gz 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98784.log 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86197.log.gz 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83095.log 2023-11-19T00:43:31.544 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84820.log.gz 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86758.log 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98784.log.gz 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98156.log 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83095.log.gz 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97533.log 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86758.log.gz 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83308.log 2023-11-19T00:43:31.545 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98156.log.gz 2023-11-19T00:43:31.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84484.log 2023-11-19T00:43:31.546 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97533.log.gz 2023-11-19T00:43:31.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82559.log 2023-11-19T00:43:31.546 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83308.log.gz 2023-11-19T00:43:31.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98702.log 2023-11-19T00:43:31.546 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84484.log.gz 2023-11-19T00:43:31.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86064.log 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82559.log.gz 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99013.log 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98702.log.gz 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97270.log 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86064.log.gz 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89506.log 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99013.log.gz 2023-11-19T00:43:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93403.log 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97270.log.gz 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.89506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96098.log 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89506.log.gz 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85174.log 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93403.log.gz 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98450.log 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96098.log.gz 2023-11-19T00:43:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97397.log 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85174.log.gz 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98450.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81081.log 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98450.log.gz 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96355.log 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97397.log.gz 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.81081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84442.log 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81081.log.gz 2023-11-19T00:43:31.549 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87574.log 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96355.log.gz 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98072.log 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84442.log.gz 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87574.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87574.log.gz 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97484.log 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98072.log.gz 2023-11-19T00:43:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97504.log 2023-11-19T00:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98324.log 2023-11-19T00:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97484.log.gz 2023-11-19T00:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87438.log 2023-11-19T00:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97504.log.gz 2023-11-19T00:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98492.log 2023-11-19T00:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98324.log.gz 2023-11-19T00:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92812.log 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87438.log.gz 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83518.log 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98492.log.gz 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.92812.log.gz 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87663.log 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86155.log 2023-11-19T00:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83518.log.gz 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82397.log 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87663.log.gz 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97610.log 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86155.log.gz 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87302.log 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82397.log.gz 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87793.log 2023-11-19T00:43:31.553 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97610.log.gz 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82149.log 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87302.log.gz 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85070.log 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87793.log.gz 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84104.log 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82149.log.gz 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89434.log 2023-11-19T00:43:31.554 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85070.log.gz 2023-11-19T00:43:31.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86895.log 2023-11-19T00:43:31.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84104.log.gz 2023-11-19T00:43:31.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.89434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86385.log 2023-11-19T00:43:31.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89434.log.gz 2023-11-19T00:43:31.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85382.log 2023-11-19T00:43:31.555 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86895.log.gz 2023-11-19T00:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82959.log 2023-11-19T00:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86385.log.gz 2023-11-19T00:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84694.log 2023-11-19T00:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85382.log.gz 2023-11-19T00:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97630.log 2023-11-19T00:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82959.log.gz 2023-11-19T00:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83852.log 2023-11-19T00:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84694.log.gz 2023-11-19T00:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87077.log 2023-11-19T00:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97630.log.gz 2023-11-19T00:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86942.log 2023-11-19T00:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83852.log.gz 2023-11-19T00:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87077.log.gz 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85112.log 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.86942.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.86364.log 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86942.log.gz 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82312.log 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85112.log.gz 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86474.log 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86364.log.gz 2023-11-19T00:43:31.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84862.log 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82312.log.gz 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82705.log 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86474.log.gz 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98576.log 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84862.log.gz 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82705.log.gz 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87260.log 2023-11-19T00:43:31.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97988.log 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98576.log.gz 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92763.log 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87260.log.gz 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96681.log 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97988.log.gz 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84084.log 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.92763.log.gz 2023-11-19T00:43:31.561 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96543.log 2023-11-19T00:43:31.562 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96681.log.gz 2023-11-19T00:43:31.562 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96017.log 2023-11-19T00:43:31.562 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84084.log.gz 2023-11-19T00:43:31.562 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83476.log 2023-11-19T00:43:31.562 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96543.log.gz 2023-11-19T00:43:31.562 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5/var/log/ceph/ceph-client.admin.96017.log: --verbose -- /var/log/ceph/ceph-client.admin.83724.log 2023-11-19T00:43:31.562 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96017.log.gz 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83602.log 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83476.log.gz 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83392.log 0.0% 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83724.log.gz 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86322.log 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83602.log.gz 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81940.log 2023-11-19T00:43:31.563 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83392.log.gz 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86322.log.gz 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83053.log 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.81940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96896.log 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81940.log.gz 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88335.log 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83053.log.gz 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97736.log 2023-11-19T00:43:31.564 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96896.log.gz 2023-11-19T00:43:31.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97272.log 2023-11-19T00:43:31.565 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88335.log.gz 2023-11-19T00:43:31.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84274.log 2023-11-19T00:43:31.565 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97736.log.gz 2023-11-19T00:43:31.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88468.log 2023-11-19T00:43:31.565 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97272.log.gz 2023-11-19T00:43:31.565 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87165.log 2023-11-19T00:43:31.566 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84274.log.gz 2023-11-19T00:43:31.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88129.log 2023-11-19T00:43:31.566 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88468.log.gz 2023-11-19T00:43:31.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98408.log 2023-11-19T00:43:31.566 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87165.log.gz 2023-11-19T00:43:31.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95916.log 2023-11-19T00:43:31.566 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88129.log.gz 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98408.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.90238.log -- replaced with /var/log/ceph/ceph-client.admin.98408.log.gz 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98970.log 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95916.log.gz 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.90238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86543.log 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90238.log.gz 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98970.log.gz 2023-11-19T00:43:31.567 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92936.log 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5/var/log/ceph/ceph-client.admin.86543.log: --verbose -- /var/log/ceph/ceph-client.admin.97398.log 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86543.log.gz 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87888.log 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.92936.log.gz 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88288.log 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97398.log.gz 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95977.log 2023-11-19T00:43:31.568 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87888.log.gz 2023-11-19T00:43:31.569 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97652.log 2023-11-19T00:43:31.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88288.log.gz 2023-11-19T00:43:31.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84526.log 2023-11-19T00:43:31.569 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95977.log.gz 2023-11-19T00:43:31.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82789.log 2023-11-19T00:43:31.569 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97652.log.gz 2023-11-19T00:43:31.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86984.log 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84526.log.gz 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82663.log 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82789.log.gz 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95721.log 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86984.log.gz 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5/var/log/ceph/ceph-client.admin.82663.log: --verbose -- /var/log/ceph/ceph-client.admin.83181.log 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82663.log.gz 2023-11-19T00:43:31.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93404.log 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95721.log.gz 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97778.log 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83181.log.gz 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96273.log 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93404.log.gz 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87349.log 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97778.log.gz 2023-11-19T00:43:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88640.log 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96273.log.gz 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83560.log 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87349.log.gz 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91832.log 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88640.log.gz 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97862.log 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83560.log.gz 2023-11-19T00:43:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.91832.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91832.log.gz 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97862.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97862.log.gz 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85277.log 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88019.log 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85277.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85277.log.gz -5 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97820.log 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98366.log 2023-11-19T00:43:31.573 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88019.log.gz 2023-11-19T00:43:31.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97820.log.gz 2023-11-19T00:43:31.574 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88600.log 2023-11-19T00:43:31.574 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98114.log 2023-11-19T00:43:31.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98366.log.gz 2023-11-19T00:43:31.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88707.log 2023-11-19T00:43:31.574 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88600.log.gz 2023-11-19T00:43:31.574 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82915.log 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98114.log.gz 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86590.log 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88707.log.gz 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84083.log 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82915.log.gz 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95790.log 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86590.log.gz 2023-11-19T00:43:31.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87930.log 2023-11-19T00:43:31.576 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84083.log.gz 2023-11-19T00:43:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82498.log 2023-11-19T00:43:31.576 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95790.log.gz 2023-11-19T00:43:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88378.log 2023-11-19T00:43:31.576 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87930.log.gz 2023-11-19T00:43:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87479.log 2023-11-19T00:43:31.576 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82498.log.gz 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96378.log 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88378.log.gz 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96189.log 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87479.log: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87479.log.gz 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93327.log 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96378.log.gz 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87752.log 2023-11-19T00:43:31.577 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96189.log.gz 2023-11-19T00:43:31.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90197.log 2023-11-19T00:43:31.578 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93327.log.gz 2023-11-19T00:43:31.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98742.log 2023-11-19T00:43:31.578 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87752.log.gz 2023-11-19T00:43:31.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.90197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90197.log.gz 2023-11-19T00:43:31.578 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84778.log 2023-11-19T00:43:31.578 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96980.log 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98742.log.gz 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85962.log 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84778.log.gz 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87705.log 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96980.log.gz 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96310.log 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85962.log.gz 2023-11-19T00:43:31.579 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86674.log 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87705.log.gz 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95720.log 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96310.log.gz 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98198.log 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86674.log.gz 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82873.log 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95720.log.gz 2023-11-19T00:43:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98198.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98198.log.gz 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96807.log 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82873.log.gz 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90959.log 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86217.log 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96807.log.gz 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.90959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97271.log 2023-11-19T00:43:31.581 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90959.log.gz 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97946.log 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86217.log.gz 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86847.log 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97271.log.gz 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84736.log 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97946.log.gz 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82455.log 2023-11-19T00:43:31.582 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86847.log.gz 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88420.log 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84736.log.gz 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95874.log 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82455.log.gz 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88420.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88420.log.gz 2023-11-19T00:43:31.583 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95874.log.gz 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87977.log 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96849.log 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87977.log.gz 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87391.log 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87035.log 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96849.log.gz 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93613.log 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87391.log.gz 2023-11-19T00:43:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84986.log 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87035.log.gz 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98282.log 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93613.log.gz 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84610.log 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84986.log.gz 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98282.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.89729.log -- replaced with /var/log/ceph/ceph-client.admin.98282.log.gz 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-11-19T00:43:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96440.log 2023-11-19T00:43:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84610.log.gz 2023-11-19T00:43:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.89729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87124.log 2023-11-19T00:43:31.586 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89729.log.gz 2023-11-19T00:43:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88984.log 2023-11-19T00:43:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96440.log.gz 2023-11-19T00:43:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83434.log 2023-11-19T00:43:31.586 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87124.log.gz 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87841.log 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88984.log.gz 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95978.log 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83434.log.gz 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87841.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.87841.log.gz 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.83350.log 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83223.log 2023-11-19T00:43:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95978.log.gz 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98910.log 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83350.log.gz 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85276.log 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83223.log.gz 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97106.log 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98910.log.gz 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84316.log 2023-11-19T00:43:31.588 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85276.log.gz 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83957.log 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97106.log.gz 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84316.log.gz 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98240.log 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83957.log.gz 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98618.log 2023-11-19T00:43:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98240.log.gz 2023-11-19T00:43:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-19T00:43:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98618.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98618.log.gz 2023-11-19T00:43:31.590 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.87213.log 2023-11-19T00:43:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82621.log 2023-11-19T00:43:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87213.log.gz 2023-11-19T00:43:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82621.log.gz 2023-11-19T00:43:31.591 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-19T00:43:31.591 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-19T00:43:31.632 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-19T00:43:31.655 INFO:teuthology.orchestra.run.smithi046.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-19T00:43:31.700 INFO:teuthology.orchestra.run.smithi046.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-19T00:43:31.702 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-11-19T00:43:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m0.265s 2023-11-19T00:43:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m0.663s 2023-11-19T00:43:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.112s 2023-11-19T00:43:33.839 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: 94.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-19T00:43:33.841 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-11-19T00:43:33.841 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m2.397s 2023-11-19T00:43:33.842 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m2.305s 2023-11-19T00:43:33.842 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.100s 2023-11-19T00:43:33.869 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.2.log: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-19T00:43:33.871 INFO:teuthology.orchestra.run.smithi181.stderr: 2023-11-19T00:43:33.871 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m2.424s 2023-11-19T00:43:33.871 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m2.331s 2023-11-19T00:43:33.871 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.102s 2023-11-19T00:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-19T00:43:34.241 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-11-19T00:43:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m2.798s 2023-11-19T00:43:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m2.700s 2023-11-19T00:43:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.106s 2023-11-19T00:43:34.242 INFO:tasks.ceph:Archiving logs... 2023-11-19T00:43:34.242 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi046/log 2023-11-19T00:43:34.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-19T00:43:34.532 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi073/log 2023-11-19T00:43:34.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-19T00:43:34.944 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi099/log 2023-11-19T00:43:34.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-19T00:43:35.296 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi181/log 2023-11-19T00:43:35.297 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-19T00:43:35.647 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-19T00:43:35.656 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-19T00:43:35.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-19T00:43:35.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-19T00:43:35.661 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-19T00:43:35.664 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-19T00:43:35.793 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-19T00:43:35.802 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-19T00:43:35.802 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:43:35.805 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:43:35.807 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:43:35.810 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-19T00:43:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:43:35.821 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:43:35.824 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:43:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:43:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-11-19T00:43:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +748us[ +748us] +/- 71ms 2023-11-19T00:43:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -284us[ -220us] +/- 52ms 2023-11-19T00:43:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -338us[ -274us] +/- 75ms 2023-11-19T00:43:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:43:35.826 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2023-11-19T00:43:35.827 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:43:35.827 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-11-19T00:43:35.828 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 +770us[ +770us] +/- 71ms 2023-11-19T00:43:35.828 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 6 377 39 -262us[ -178us] +/- 52ms 2023-11-19T00:43:35.828 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -303us[ -303us] +/- 75ms 2023-11-19T00:43:35.828 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:43:35.829 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:43:35.829 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-11-19T00:43:35.829 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 +770us[ +778us] +/- 71ms 2023-11-19T00:43:35.829 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -269us[ -262us] +/- 52ms 2023-11-19T00:43:35.829 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -316us[ -308us] +/- 75ms 2023-11-19T00:43:35.829 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:43:35.831 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-19T00:43:35.831 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2023-11-19T00:43:35.831 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 +786us[ +786us] +/- 71ms 2023-11-19T00:43:35.831 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -266us[ -188us] +/- 52ms 2023-11-19T00:43:35.831 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -319us[ -319us] +/- 75ms 2023-11-19T00:43:35.831 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-19T00:43:35.832 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-19T00:43:35.840 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-19T00:43:35.841 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-19T00:43:35.849 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-19T00:43:35.979 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-19T00:43:36.078 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-19T00:43:36.176 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-19T00:43:36.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:43:36.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:36.312 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:43:36.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:36.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:43:36.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:36.380 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-19T00:43:36.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:36.413 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-19T00:43:36.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-19T00:43:36.432 INFO:teuthology.task.internal:Duration was 772.631387 seconds 2023-11-19T00:43:36.432 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-19T00:43:36.441 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-19T00:43:36.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-19T00:43:36.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-19T00:43:36.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-19T00:43:36.449 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-19T00:43:36.489 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:43:36.491 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:43:36.495 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:43:36.497 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-19T00:43:36.840 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-19T00:43:36.840 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2023-11-19T00:43:36.841 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-19T00:43:36.862 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2023-11-19T00:43:36.862 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-19T00:43:36.888 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2023-11-19T00:43:36.888 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-19T00:43:36.916 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2023-11-19T00:43:36.916 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-19T00:43:36.945 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-19T00:43:36.945 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-19T00:43:36.948 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-19T00:43:36.950 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-19T00:43:36.959 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-19T00:43:37.013 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-19T00:43:37.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-19T00:43:37.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-19T00:43:37.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-19T00:43:37.028 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-19T00:43:37.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-19T00:43:37.158 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-19T00:43:37.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-19T00:43:37.188 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-19T00:43:37.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-19T00:43:37.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-19T00:43:37.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-19T00:43:37.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.280 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.285 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.306 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2023-11-19T00:43:37.307 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2023-11-19T00:43:37.308 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2023-11-19T00:43:37.333 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2023-11-19T00:43:37.370 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:37.384 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:37.398 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:37.412 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-19T00:43:37.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-19T00:43:37.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-19T00:43:37.436 INFO:teuthology.task.internal:Transferring archived files... 2023-11-19T00:43:37.437 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi046 2023-11-19T00:43:37.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-19T00:43:37.476 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi073 2023-11-19T00:43:37.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-19T00:43:37.511 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi099 2023-11-19T00:43:37.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-19T00:43:37.547 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827/remote/smithi181 2023-11-19T00:43:37.547 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-19T00:43:37.582 INFO:teuthology.task.internal:Removing archive directory... 2023-11-19T00:43:37.582 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-19T00:43:37.584 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-19T00:43:37.586 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-19T00:43:37.589 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-19T00:43:37.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-19T00:43:37.643 INFO:teuthology.task.internal:Not uploading archives. 2023-11-19T00:43:37.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-19T00:43:37.660 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-19T00:43:37.660 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-19T00:43:37.663 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-19T00:43:37.665 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-19T00:43:37.667 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-19T00:43:37.675 INFO:teuthology.orchestra.run.smithi046.stdout: 265803 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 19 00:43 /home/ubuntu/cephtest 2023-11-19T00:43:37.677 INFO:teuthology.orchestra.run.smithi073.stdout: 265983 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 19 00:43 /home/ubuntu/cephtest 2023-11-19T00:43:37.679 INFO:teuthology.orchestra.run.smithi099.stdout: 265245 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 19 00:43 /home/ubuntu/cephtest 2023-11-19T00:43:37.686 INFO:teuthology.orchestra.run.smithi181.stdout: 265983 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 19 00:43 /home/ubuntu/cephtest 2023-11-19T00:43:37.687 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-19T00:43:37.696 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-19T00:43:37.716 INFO:teuthology.nuke:Checking targets against current locks 2023-11-19T00:43:37.741 DEBUG:teuthology.nuke:shortname: smithi046 2023-11-19T00:43:37.742 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-19T00:43:37.767 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.054316', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQBHS/YCkprHvrURc0T4/2aDuLdCy8qUyqDYAc7KrJleX5+zwSGWZFSBH1IKD+3+HsJLWXsbri5WgOTRUvbtjw='} 2023-11-19T00:43:37.770 DEBUG:teuthology.nuke:shortname: smithi073 2023-11-19T00:43:37.771 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-19T00:43:37.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.056324', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlPHOv6p5VaKvmRzZSAowT6fF1TAUztcdWUe8Re0wnn0ED6wT9Ew5Og+Fvnc34P6v0mIISXY8eiDsXaoMhhoHQ='} 2023-11-19T00:43:37.799 DEBUG:teuthology.nuke:shortname: smithi099 2023-11-19T00:43:37.799 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-19T00:43:37.821 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.059671', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyNra49sqNfE5JtecpgVnnD0W7aNE2VivweYAVTC02O/J6A1juzldgIkYHaS7Aa4syjYVS55LVXI4yDiN8JMB0='} 2023-11-19T00:43:37.830 INFO:teuthology.orchestra.console.smithi046:Power off 2023-11-19T00:43:37.830 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T00:43:37.842 DEBUG:teuthology.nuke:shortname: smithi181 2023-11-19T00:43:37.842 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-19T00:43:37.854 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-11-19T00:43:37.854 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:37.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:54:50-powercycle-main-distro-default-smithi/7461827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 00:22:18.058164', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0LdHkJ32dDApuGXu3KyH+/tCuOfSVpKJ7fnTRROW7N40indaSRMfXoBxvzOI+X/s+Ld8vzHPaesXljpAu5kek='} 2023-11-19T00:43:37.874 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-19T00:43:37.875 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T00:43:37.891 INFO:teuthology.orchestra.console.smithi099:Power off 2023-11-19T00:43:37.891 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T00:43:37.898 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-19T00:43:37.898 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:37.908 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-19T00:43:37.912 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-11-19T00:43:37.912 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:37.921 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-19T00:43:37.933 INFO:teuthology.orchestra.console.smithi181:Power off 2023-11-19T00:43:37.933 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T00:43:37.942 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-11-19T00:43:37.954 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-11-19T00:43:37.954 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:37.975 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-11-19T00:43:41.909 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:41.922 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:41.943 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:41.976 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:42.019 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-19T00:43:42.032 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-19T00:43:42.053 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-11-19T00:43:42.085 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-11-19T00:43:46.021 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:46.033 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:46.054 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:46.085 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:46.132 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-19T00:43:46.142 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-19T00:43:46.163 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-11-19T00:43:46.195 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-11-19T00:43:46.233 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-11-19T00:43:46.295 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-11-19T00:43:50.143 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:50.164 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T00:43:50.254 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-19T00:43:50.273 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-11-19T00:43:50.356 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-19T00:43:50.374 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-11-19T00:43:50.479 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} duration: 772.6313872337341 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi046 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0b7a274d01b04373a1f27f2c14a0bb48 status: fail success: false 2023-11-19T00:43:50.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T00:43:50.562 INFO:teuthology.run:FAIL